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PREFACE  TO  SECOND  EDITION 


This  handbook  wa A  reprinted  fiv e  time*  in  its  original  edition. 

The  continuing  high  demand  motivated  the  c ompilation  of  a  second  edition, 
which  differs  om  tiie  first  by  editorial  modification  and  by  the  substi- 
tution  a  new  Chapter  IV,  "Output- -Judging  Benefit."  Thii  new  chapter 
urn  written  by  the  Bene  fit /Output  Determination  Committee  of  the  Defense 
Economic  Analysis  Council  and  represents  an  update  Benefit  determination 
procedures . 

I  have  retained  the  foreword  to  the  finst  edition  because  it  presents 
in  succinct  form  the  underlying  concept  Economic  Analysis. 


Suggestions  fox  improvement  of  this  handbook  axe  welcomed  and  should 
be  submitted  directly  to  the  Chairman,  Defense  Economic  Analysis  Council, 
OASP(C)  SPSI,  Washington,  D.  C.  20501. 


Chairman,  PE AC 
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FOREWORD 


This  handbook  is  a  result  of  the  effort  by  the  Defense  Economic  Analysis 
Council,  Handbook  Committee,  representing  the  Services  and  Agencies  of  the 
Department  of  Defense.  It  is  designed  as  a  starting  point  for  personnel  who 
have  little  or  no  experience  with  Economic  Analysis.  The  Council  is  guided 
by  the  thoughts  of  the  Assistant  Secretary  of  Defense  (Comptroller),  The 
Honorable  Robert  C.  Moot:  l 

.  .We  wilt  review  some  co/mon-sense  idem,  that  ale  ho* 
at  all  complicated,  and  see  a  $cu’  simple,  practical  example. s  of 
the  application  o d  Economic  Analysis .  Economic  Analysis  has  much 
in  common  with  value  engineering,  cost  reduction  program s,  and 
cost-benefit  staff  studies.  The  Economic  Analysis  program  is,  in 
fact,  our  attempt  at  borrowing  the  best  or  most  practical  features 
of  eaefi  05  these  rather  different  programs  and  bringing  them 
together  in  a  consolidated  set  of  guidelines.  These  guidelines 
can  be  easily  understood  and  meaningfully  applied  by  all  managers 
from  the  Incest  to  the  highest  level  within  your  Departments . " 

In  discussing  what  might  be  done  to  further  the  use  of  Economic 
Analysis,  Mr.  Moot  said: 

"First,  under  our  participatory  managemint  philosophy, 
the  initiative  of  defining  priority  areas  for  doing  economic 
analyses  and  program  evaluations  is  left  to  the  DOD  components . 

The  components  arc  also  responsible  for  assuring  that  appropriate 
analyses  are  included  in  tiie  decision  piecc.4 J . 

"The  second  point  I  irnnf  to  emphas <ze  is  that  the  job  ahead, 
as  I  see  it,  is  to  reform  and  strengthen  an  existing  system,  not 
to  estabtisl'ra  new  one.  In  nj  judgment,  there  already  exists 
within  die  Department  a  vast  amount  otf  manpower  and  other 
resources  dedicated  to  performing  analysis  and  reviewing,  and 
using  the  products  of  analysis.  Our  goal  is  to  pull  aU  those 
individual  efforts  together. 

"Third,  the  idea  that  Economic  Analysis  muif  be  integrated 
into  the  existing  decision  process  is  not  new,  but  it  is  critical. 

An  analysis  should  be  prepared  at  the  operational  level  and 
reviewed  by  those  having  a  primary  responsibility  for  the  success 
of  a  program  or  project.  We  do  not  intend  ((oi  Economic 
Analysis  to  become  the  sole  factor  in  making  decisions  about 
efficient  use  of  resources.  But  it  is  becoming  increasingly 
apparent  that  new  funding  requirements  are  difficult  to 
justify  if  local  managers  have  not  made  a  suitable  Economic 
Analysis  to  baefc  up  their  decisions .  This  does  not  mean,  of 
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course  that  every  project  supported  by  an  Economic  Analys is 
milt  be  funded.  It  does  mean  that  the  decision -make*  should 
at  least  know  the  costs  and  benefits  o (  lus  actions,  and  what 
trade-o((s  have  been  indicated  in  lus  decisions.  To  quote  a 
compute r  manu(acturer' s  accent  ad,  'No  one  can  take  the 
ultimate  weight  o(  decision -making  you*  shoulders.  But 

the  more  you  know  about  how  things  scatty  ase,  the  lightes 
the  busden  will  be.'  1  aelieve  thorough  Economic  Analysis  o ( 
the  management  problems  you  ( ace  will  provide  better  overall 
visibility  and  will  assist  in  your  decision-making.  The 
fourth  point  T  want  to  make  is  that  managers  need  not  be 
erperts  in  Economic  Analysis  to  get  the  most  benefits  (rom 
its  use  --  just  as  you  needn't  be  a  computer  systems  analyst 
to  have  the  computer  do  things  (o r  you.  There  arc  capable 
stasis  available  to  perform  Economic  Analyses  --  but,  you 
must  initiate  their  use  and  consider  the  results  in  arriving 
at  your  decisions.  Resource  Management  problems  coming  to 
you  (or  decision  should  have  been  subjected  to  an  economic 
analysis  by  your  sta((s . 


"Host  the  tools  and  techniques  comprising  and  supporting 
Economic  Analysis  are  relatively  simple  --  tl\ey  are  not 
sophisticated,  esoteric,  or  (or -out  --  and  they  can  UF~ 
used  by  people  with  gene-ral  os  opposed  to  technical  back- 
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INTRODUCTION 


CHAPTER  I  - 

A.  WHAT  THIS  BOOK  IS  ABOUT 


Every  manager  devotes  considerable  time  and  effort  to  planning  for  the 
future,  and  every  plan  Is  concerned  primarily  with  allocating  scarce 
resources.  This  book  explains  a  process  M  h  will  aid  the  manager  in 
making  resource  allocation  decisions.  Thi  ,.iethod  of  approaching  a  complex 
problem  of  choice  is  called  Economic  Analysis. 

Economic  Analysis  concerns  the  basic  problem  of  economic  choice  (value 
received  for  value  sacrificed)  and  as  such,  has  bec;n  applied  by  each  of  us 
implicitly  and  informally  whenever  we've  made  a  decision  in  the  market  place. 
This  handbook  formalizes  that  decision  process.  However,  our  objective  is 
not  to  present  a  "cookbook"  of  detailed  procedures,  nor  is  it  to  deal  with 
abstract  concepts.  Rather,  it  attempts  to  promote  understanding  of  econo¬ 
mic  analysis  concepts  and  methodology  so  that  these  techniques  may  be  used 
as  tools  for  effective  decision  making  at  all  echelons  within  the  Depart¬ 
ment  of  Defense. 

The  general  format  for  an  Economic  Analysis  involves  the  determination 
of  the  cost  and  benefit  of  each  future  course  of  action.  Through  a  cost- 
benefit  or  cost-effectiveness  analysis  the  decision  maker  can  utilize  a 
set  of  facts  and  figures  to  select  a  preferred  means  of  achieving  certain 
goals.  After  specifying  the  objectives  and  assumptions,  devising  appro¬ 
priate  alternative  courses  of  action,  costing  these  alternatives,  and 
determining  the  benefits  or  effectiveness  of  each  alternative,  a  preferred 
action  or  investment  may  be  chosen.  The  criterion  used  by  the  decision 
maker  is  the  maximization  of  benefit  minus  cost  if  the  two  are  commensurab le 
(e.g.,  both  measured  in  dollars)  or,  if  they  are  not,  the  maximization  of 
benefits  for  a  given  cost,  or  the  achievement  of  a  given  performance  objec¬ 
tive  at  a  minimum  cost. 

B .  THE  AUDIENCE 


This  book  was  written  in  order  to  establish  a  procedural  routine  for 
personnel  who  have  little  or  no  experience  with  economic  analysis.  It  will 
also  be  of  value  to  those  supervisors  and  functional  managers  who  must 
initiate  or  review  economic  analyses.  For  those  who  cannot  read  tills  book 
in  its  entirety,  an  adequate  knowledge  of  the  methodology  of  economic 
analysis  can  be  obtained  from  Chapter  II,  "The  Process,"  with  special 
attention  to  the  outline  of  the  method  on  page  Additionally,  the  super¬ 
visor  or  functional  manager  should  become  familiar  with  the  "Guide  for 
Reviewers,"  Chapter  VI. 

Lcwer  echelons  are  encouraged  to  develop  detailed  procedures  for  analysis 
appropriate  to  their  missions  by  using  the  general  procedural  routine  pre¬ 
sented  in  this  document. 
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THE  PROCESS 


CHAPTER  II  - 
A.  BACKGROUND 


Economic  analysis  is  a  conceptual  framework  for  systematically  investi¬ 
gating  problems  of  choice.  An  economic  analysis  postulates  alternative 
means  of  satisfying  an  objective  and  investigates  the  costs  and  benefits 
of  each  of  these  alternatives.  Hiis  orderly,  comprehensive  presentation 
of  the  important  considerations  of  each  alternative  assists  the  manager 
in  making  and  reviewing  decisions.  It  does  this  by: 

(a)  Focusing  Informal  thinking. 

(b)  Surfacing  hidden  assumptions,  making  clear  their  logical  implica- 
t ions . 

(c)  Providing  an  effective  vehicle  for  communicating  the  considerations 
which  support  a  recommendation. 

Hie  methodology  of  economic  analysis  is  depicted  on  the  following  pages 
of  this  chapter.  The  next  three  chapters  of  the  handbook  serve  to  further 
define  the  final  three  steps  of  the  process.  Chapter  III  discusses  the 
procedures  and  techniques  to  be  used  in  estimating  costs.  Chapter  IV 
delineates  a  method  for  determining  benefit.  Finally,  Chapter  V  presents 
a  method  for  ranking  alternatives  and  nesting  the  conclusions. 

B .  THE  ELEMENTS  OF  THE  PROCESS 


The  key  elements  of  an  economic  analysis  are:  (1)  Establishing  and 
defining  the  goal  or  objective  desired,  (2)  Searching  out  hypothetical 
alternatives  for  accomplishing  the  objective,  (3)  Formulating  appropriate 
assump cions ,  (4)  Determining  the  cost  (Inputs)  and  benefits  (outputs)  of 
each  alternative,  (5)  Comparing  costs  and  benefits  of  all  alternatives  and 
ranking  the  alternatives,  and  (6)  Testing  the  sensitivity  of  major  uncer¬ 
tainties  on  the  outcome  of  the  analysis. 

1  -  Establishing  Objectives 

The  most  important  step  in  analysis  is  the  first  step,  the  definition 
of  the  objective.  Most  simply  stated,  an  objective  is  some  fixed  standard 
of  accomplishment.  In  establishing  an  objective,  we  concurrently  and 
implicitly  estab  lish  the  criteria  by  which  we  will  measure  the  relative 
benefits  and  costs  of  each  alternative. 

In  every  instance,  whether  the  objective  is  to  provide  logistic  support, 
or  field  an  effective  weapon  system  or  to  provide  an  organization  able  to 
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function  in  terras  of  quantity,  ti,?e  or  degree;  the  objective  of  the  manager 
is  to  best  achieve  the  planned  mission  of  his  organization. 

We  may,  then,  categorize  the  objective  of  an  analysts  according  to  its 
impact  on  the  mission  of  an  organization. 

There  are  four  levels  of  abstraction  upon  which  the  organization's 
mission  can  be  defined.  From  the  least  abstract  to  the  most,  they  are: 

( 1)  Basic  Activity:  The  number  of  man-hours  or  units  of  work  performed. 
Examples  are:  engine  hours,  aircraft  flying  hours,  hours  manned,  instructor 
platform  hours.  When  basic  activities  are  evaluated  against  a  standard 

or  against  costs,  they  fall  within  a  unit's  "management  indicator"  program, 

(2)  Organizational  Product:  What  is  produced  by  an  organization.  For 
example,  personnel  trained,  engines  repaired,  weapons  delivered,  etc.  This 
form  of  mission  description  is  applicable  to  those  organizations  with  a 
defined,  physical  output.  Organizational  products  are  also  used  in  manage¬ 
ment  Indicator  programs,  (3)  Extra-Organizational  Value:  These  include  the 
products  or  activity  of  the  immediate  organization  expressed  in  terms  of 
the  benefits  received  by  other  organizations  or  organization  levels.  For 
example,  ' ae  quality  of  engines  repaired,  adequacy  of  persons  trained,  or 
tactical  assistance  as  a  result  of  accurate  weapons  delivery.  This  is 
empirical,  after  the-fact-data  that  is  not  necessarily  tracked  or 
measured.  (4)  Social  Values:  Public  benefits  which  are  equally  available 
to  all  regardless  of  whether  they  were  directly  associated  with  the  organi¬ 
zation  that  provided  them.  For  example:  National  defense,  law  enforcement, 
public  highways,  environmental  control,  etc.  The  definition  of  this  mission 
level  has  proved  extremely  difficult  to  narrate. 

By  relating  the  objective  to  the  current  mission  of  the  organization 
we  can  establish  certain  criteria  for  judging  each  suggested  alternative. 

For  example,  each  of  100  persons  must  be  trained  to  perform  an  error-free 
overhaul  of  an  aircraft  engine  after  80  platform  hours  of  instruction  or 
less.  We  have  established  three  criteria:  100  persons  must  be  trained, 
their  training  must  be  completed  in  80  hours  or  less,  and  they  must  be  able 
to  execute  perfectly  what  they  have  learned. 


2  -  Choosing  Alternatives 


Once  the  objective  of  an  economic  analysis  has  been  stated,  the  next 
step  is  to  determine  all  feasible  means  or  ways  of  meeting  the  objective. 


It  is  the  analyst's  job  to  study  all  feasible  alternatives  and  to 
present  to  the  decision  maker  those  alternatives  most  cost  effective. 

This  calls  for  a  great  deal  of  skill  on  the  part  of  the  analyst  and  a 
certain  amount  of  interaction  wl:  (he  decision  maker  so  that  the  proper 
a  priori  judgments  can  be  made.  Often,  one  who  prepares  an  economic 
analysis  is  directed  to  select  alternatives  in  keeping  with  certain  constraints, 
e.g.,  manpewer,  facilities  or  funding  limitations.  This,  in  itself,  tends 
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to  eliminate  some  alternatives.  Despite  the  a  priori  rejection  of  some 
alternatives,  it  is  only  through  the  reiteration  of  the  analysis  for  many 
alternatives  that  the  analyst  may  feel  secure  in  his  final  recommendation. 

3  -  Formulating  Assumptions 

Assumptions  are  statements  made  to  support  and  reasonably  limit  the 
scope  of  a  study.  Because  an  assumption  is  a  "gi.en"  as  opposed  to  a 
"fact"  and  relates  to  a  future  occurence,  it  Involves  a  degree  of  uncer¬ 
tainty.  For  this  reason,  regardless  of  the  degree  of  Impact  they  might 
have  on  the  analysis,  it  is  strongly  recommended  that  all  assumptions 
pertinent  to  its  preparation  be  so  identified,  for  the  use  of  undocumented 
assumptions  detracts  from  the  credibility  of  an  analysis. 

Additionally,  it  is  important  that  we  do  not  confuse  assumptions  with 
facts  or  attempt  to  ease  our  role  by  utilizing  assumptions  when,  with 
research,  factual  data  could  be  presented.  For  example,  if  we  are 
considering  landfill  as  an  nternative  to  solving  a  disposal  problem  stemming 
from  increased  waste,  we  might  include  in  die  study,  the  assumption  that 
sufficient  land  foi  this  operation  is  available  within  a  20  mile  radius  of 
the  installation.  However,  in  this  particular  instance,  there  may  have  been 
no  obstacle  preventing  us  from  the  research  necessary  to  present  this  element 
of  data  as  a  fact  rather  than  as  an  assumption. 

Two  very  significant  assumptions  that  must  be  made  in  all  economic 
analyses  concern  the  "economic  life"  of  each  alternative  and  the  period 
over  which  we  will  compare  the  alternatives. 

a.  Economic  Life. 

The  economic  life  of  a  capital  investment  project  is  the  period  of  time 
over  which  the  benefits  to  be  gained  from  a  project  may  reasonably  be 
expected  to  a' crue .  Benefit  from  a  project  is  limited  ultimately  by  its 
physical  Ilf'  .  This  is  the  period  a  facility  or  piece  of  equipment  will  be 
available  before  it  is  exhausted  In  a  physicu'  sense,  that  is,  decayed  or 
deteriorated.  The  economic  life  of  a  project  is  further  limited  by  its 
technological  life.  That  is  the  period  before  which  improved  technology 
makes  the  building,  machine,  etc.,  obsolete.  The  economic  life  of  a  project 
may  further  be  limited  by  military  or  political  consideratio  is  which  may 
suggest  benefit  accrual  for  a  much  shorter  period.  The  economic  lives  of 
the  alternatives  will  ultimately  govern  the  time  period  to  be  covered  by 
an  economic  analysis.  Economic  life  is  a  key  variable  and  it  is  important 
to  make  the  best  possible  determination. 

Maximum  economic  lives  are  established  for  the  categories  of  investments 
listed  below  even  though  the  equipment  or  facilities  Involved  may  have  a 
physical  or  technological  life  of  a  greater  number  of  years:  Automatic 
Data  Processing  Equipment  -  8  years;  Buildings  -  25  years;  Operating 
Equipment  -  10  years;  Utilities,  Plants,  and  Utility  Distribution  systems  - 
25  years  (this  category  includes  investment  projects  for  electricity,  water, 
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gas,  telephone,  and  similar  utilities);  Weapon/Support  Systems  -  The 
maximum  economic  life  will  vary  by  type  of  weapon  or  support  system. 

In  general,  the  economic  life  will  be  measured  against  a  stipulated 
level  of  threat,  or  represent  the  period  during  which  a  given  mission  or 
function  is  required  or  can  be  supported.  Also,  if  the  economic  life  of 
a  system  is  expected  to  be  less  than  the  specified  maximum  life,  the  shorter 
life  must  be  used  f.  r  purposes  of  the  analysis. 

b.  The  Period  of  Comparison. 

It  Is  one  thing  to  ascertain  the  life  expectancy  of  each  of  our 
alternatives;  it  is  qu<  te  another  to  appropriately  compare  these  lives 
within  the  analysis.  When  faced  with  two  or  more  alternatives  with 
different  economic  lives,  the  analyst  must  make  an  assumption  as  to  when 
to  begin  the  period  of  comparison. 

The  decision  maker  may  state,  early  in  the  analysis,  at  which  point  in 
time  he  wishes  any  one  or  all  of  the  alternatives  to  begin  yielding  benefits. 
Given  this  point  in  time,  the  analyst  can  then  de' ermine  the  first  year  in 
which  expenditures  must  be  made  to  satisfy  t'e  ’oenefit  yield  date"  as  set 
by  the  decisior  maker.  If  the  decision  maker  fails  to  provide  this  "benefit 
yield  date,"  the  analyst  must  arrange  the  expenditures  so  that  the  alter¬ 
natives  begin  to  produce  benefits  in  the  same  year. 

In  either  case,  the  first  year  in  which  expenditures  will  have  to  be 
made  for  any  one  of  the  alternatives  should  be  -onsidered  the  base  year 
or  year  "1"  for  all  alternatives.  For  example,  it  is  possible  for  option 
A  to  require  investment  costs  for  three  years  before  yielding  benefit, 
while  option  B  has  zero  costs  for  that  year.  This  imposes  an  appropriate 
interest  cost  for  the  capital  required  to  finance  the  alternative  which 
requires  a  longer  lead  time. 

The  period  of  comparison  extends  throug1  he  time  during  which  an  asset 
will  perform,  or  a  service  will  be  rendered,  according  to  some  established 
standard  of  benefit.  When  an  alternative's  benefits  fall  below  this 
standard,  its  useful  life  has  ended.  The  alternative  with  the  longest 
economic  life  may  determine  the  end  of  the  comparison  period.  However, 
the  decision  maker  or  analyst  may  shorten  this  period  consistent  with  the 
objectives  and  assumptions  of  thj  analysis.  Whether  the  longest  or  the 
shortest  life  is  used  as  a  basis,  adjustment  for  unequal  life  is  required. 

If  the  shortest  life  is  used  the  residual  values  of  the  alternatives 
with  longer  lives  must  be  recognized  in  the  cost  computation  for  those 
alternatives.  Should  the  longest  life  be  used  to  establish  the  time 
period  of  the  analysis  the  cost  of  extending  the  benefit  procut  ing  years  of 
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those  alternatives  with  a  shorter  life  must  be  recognized.  Care  should  be 
exercised  to  insure  that  the  complete  and  valid  costs  for  each  alternative 
for  the  entire  length  of  the  analysis  are  presented  to  tlte  decision  maker. 
Another  alternative  would  be  to  use  the  t’yrform  Annual  Cost  method  as  a 
means  of  comparison.  / 

4  -  Determining  Costs  and  Benefits 

There  are  certain  formal  techniques  for  conducting  a  cost  analysis. 

They  are  explained  in  some  detail  in  Chapter  Ill.  There  are  three  methods 
for  analyzing  costs.  Two  are  supported  by  a  defined  formal  process. 

The  third  is  largely  dependent  upon  the  judgment  of  the  cost  analyst.  They 
are  the  parametric  method  and  the  analogy  method.  The  appropriate  esti¬ 
mating  method  must  be  determined  and  exercised  be  the  analyst  to  arrive 
at  the  estimated  cos'  of  each  alternative.  Formal  costing  techniques 
normally  require  the  services  of  a  costing  specialist.  Cost  analysts  are 
available  within  the  Comptroller  function  in  most  commands.  However, 
adequate  cost  estimates  may  be  made  without  the  assistance  of  a  cost 
analyst.  The  adequacy  of  the  cist  analysis  must  be  Judged  by  the  decision 
maker  within  the  context  of  the  problem. 

An  economic  analysis  is  most  effective  when  applied  to  situations  in 
which  output  can  be  defined  in  terms  of  physical  yield.  It  may,  however, 
be  applied  with  less  precision  where  the  outputs  are  nonquanti  fiable  and 
must  be  accurately  defined  and  measured  in  terms  of  relative  benefit. 

Hie  determination  of  value  or  benefit  is  a  tenuous  and  difficult 
decision.  However,  a  method  for  quantifying  the  more  tangible  aspects  of 
benefit  is  presented  in  Chapter  IV.  !t  consists  of  four  steps:  (a) 
Determine,  l.ist  and  Define  Relevant  Benefits,  (b)  establish  Sources  of 
Information  for  Benefit  Determination,  (c)  Collect  and  Display  Information 
for  Benefit  Determination,  and  (d)  Summarize,  Evaluate  and  Present  Benefit 
Determination  for  Alternatives  of  the  Economic  Analysis. 

5  -  Comparing  Costs  and  Benefits  and  Ranking  'he  Alternatives 

The  actual  comparison  of  each  alternative  in  terms  of  its  cost  and 
benefit  is  accomplished  in  this  step.  If  we  can  measure  cost  and  benefit 
on  continuous  scales  we  may  use  a  graphical  method  of  comparison.  We 
start  by  tabulating  and  then  plotting  the  cost  versus  the  benefit  for  each 
alternative  with  the  high  benefit  for  the  low  cost.  If  one  alternative  is 
strictly  dominant  over  all  time  periods  and  for  all  levels  of  effectiveness 
and  cost,  we  have  strict  dominance  and  we  can  rank  our  alternatives 
immediately.  Unfortunately,  this  is  not  usually  the  case.  It  is  necessary 
to  constrain  the  problem  in  a  way  that  one  alternative  will  be  preferable 
to  the  others.  Thus,  we  select  either  a  fixed  cost  or  fixed  benefit 
schedule  and  determine  hew  the  alternatives  will  vary  over  time.  Our 
analysis  may  then  be  repeated  for  inflated  (current  year)  dollars  If 
necessary,  and  finally  a  ranking  of  alternatives  can  be  made. 
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Hie  anal' st  may  rank  alternatives  by  one  of  three  general  criteria. 

These  criteria  conform  to  the  three  basic  types  of  cost/benefit  relationship 
Unequal  Cost/Equal  Effectiveness,  Equal  Cost/Unequal  Effectiveness,  and 
Unequal  Cost/Unequal  Effectiveness.  The  three  criteria  are:  (a)  Least  cost 
for  a  given  level  of  effectiveness,  (b)  Most  effectiveness  for  a  given 
cost  constraint,  (c)  Largest  ratio  of  effectiveness  to  cost. 

The  first  two  criteria  are  easier  to  handle  than  the  third.  The 
problem  with  the  third  criterion  is  that  it  tends  to  wash  out  levels  of 
expenditure  and  relative  capabilities  of  the  alternatives.  For  example, 
the  effectiveness  to  cost  ratio  of  1:10  applies  to  an  option  whose 
effectiveness  is  rated  at  1000  and  whose  cost  is  $10,000  and  to  a  much  more 
austere  option  whose  effectiveness  is  10  and  whose  cost  Is  only  $100.  The 
ratio  of  effectiveness  to  cost  should  be  used  as  a  criterion  only  when 
costs  or  capabilities  are  reasonably  close  for  each  of  the  alternatives. 

6  -  Testing  Alternatives  Under  Uncertainty 

Since  most  important  decisions  involve  elements  of  uncertainty,  an 
Ideal  economic  analysis  should  address  those  areas  of  uncertainty  about 
the  state  of  the  world  in  the  future  (technologically,  politically,  etc.). 
Techniques  that  are  often  used  are  contingency  analysis,  sensitivity 
analysis,  and  "a  fortiori"  analysis. 

Contingency  analysis  is  the  Investigation  of  hew  the  rankirg  of 
alternatives  holds  up  when  a  relevant  change  in  criteria  for  evaluating  the 
alternatives  is  postulated,  or  a  major  change  in  the  general  environment 
is  assumed. 

Sensitivity  analysis  can  be  applied  in  a  situation  where  there  are 
a  few  key  parameters  about  which  the  analyst  is  very  uncertain.  Instead 
of  using  expected  values  for  these  parameters,  the  analyst  may  use  several 
values  (say,  high,  medium,  and  low)  in  an  attempt  to  see  how  sensitive 
the  ranking  of  the  alternatives  is  to  variations  in  the  uncertain  parameters 

"A  fortiori"  analysis  is  applicable  to  derision  problems  where 
generally  accepted  intuitive  judgment  strongly  favors  one  alternative. 
However,  based  on  preliminary  analysis,  it  appears  to  the  analyst  that 
this  alternative  might  be  a  poor  choice  and  another  may  be  most  advantageous 
In  performing  the  analysis  of  the  two,  the  analyst  can  deliberately  resolve 
the  major  uncertainties  in  favor  of  the  generally  favored  alternative,  and 
see  h<w  the  other  alternative  compares  under  these  adverse  conditions.  If 
the  latter  still  looks  good,  the  analyst  has  a  strong  case  in  its  favor. 
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Apart  from  the  usefulness  of  the  techniques  discussed  above  in  a  direct 
analytical  sense,  they  may  also  contribute  insights  that  can  lead  to  a  n«# 
alternative  that  will  provide  a  reasonably  good  hedge  against  a  range  of 
the  more  significant  uncertainties.  This  may  be  difficult  to  do,  but  ir 
it  can  be  accomplished,  it  will  offer  one  ot  the  best  ways  to  compensate 
for  uncertainty. 

This  is  the  process  of  economic  analysis.  It  must  be  remembered  that 
it  is  only  a  tool  and  should  be  responsive  in  its  application  to  the 
problem,  the  environment  and  especially,  the  prerogatives  of  the  decision 
maker.  The  decision  maker  wants  facts.  An  economic  analysis  attempts  to 
supply  him  with  these  facts  so  that  logical  decisions  can  be  made. 
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INPUT  -  ESTIMATING  COSTS 


CHAT~',R  III  - 

A.  PREFACE:  THE  APPROACH  -  INPUT  VS  OUTPUT 

Once  we  have  chosen  discrete  hypothetical  alternatives  which  may 
satisfy  our  objectives,  we  must  reduce  each  of  these  alternatives  to  its 
most  general  components.  Each  alternative  will  have  some  "Input"  (the 
cost  of  achieving  benefit,  worth  of  yield)  and  "output"  (benefit,  worth  or 
yield).  This  chapter  suggests  an  approach  for  determining  the  input 
(costs)  necessary  to  accomplish  future  courses  of  action. 

B.  TWO  COSTING  METHODS 

There  are  two  formal  methods  for  conducting  a  cost  estimate: 

1.  Industrial  Engineering  Method:  This  approach  consists  of  a 
consolidation  of  estimates  from  various  separate  work  segments  into  a  total 
project  estimate.  As  an  example,  the  estimated  cost  of  production  of  a  new 
model  "widget,"  consisting  of  work  contributions  from  10  separate  work 
divisions  in  a  plant,  could  well  be  a  consolidation  of  10  separate  and 
detailed  estimates,  each  of  which  may  be  composed  of  several  estimates 
itself. 

Estimating  by  engineering  methods  is  based  on  extensive  knowledge  of 
the  system  characteristics.  It  is  necessary  for  the  analyst  to  have  a 
detailed  knowledge  of  the  system,  the  production  processes,  and  the  pro¬ 
duction  organization.  In  using  the  engineering  method,  the  system  or 
item  of  hardware  is  broken  down  into  its  lower  level  components  and  esti¬ 
mates  of  each  component  are  made.  Parametric  methods  are  usually  used  in 
estimating  the  costs  of  these  components,  and  the  results  are  combined  with 
estimates  of  the  costs  of  integrating  the  components  to  arrive  at  a  total 
system  cost.  An  advantage  to  this  method  is  that  it  separates  the  parts 
of  the  system  on  which  little  data  is  available  and  which  require  special 
treatment . 

Hcvever,  the  detail  required  for  an  engineering  analysis  is  not  always 
available  to  a  government  cost  analyst,  thus  making  this  approach  difficult 
to  apply.  The  time  expended  for  each  operation  such  as  setup,  milling,  and 
filing,  must  be  multiplied  by  a  labor  rate  and  each  of  these  costs  must 
then  be  added  to  reach  the  total  cost.  The  approach  is  sometimes 
difficult  to  apply,  even  by  the  vendor.  For  an  example,  one  large  aerospace 
firm  judges  that  the  use  of  this  approach  to  estimate  the  cost  of  an  air¬ 
frame  requires  more  than  4000  separate  estimates. 

Additionally,  each  Individual  making  his  separate  estimate  often  has 
insufficient  information  available  to  make  a  reliable  estimate,  and  little 
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means  to  evaluate  Inherent  errors.  Therefore,  a  cost  estimate  combined 
from  as  few  as  10  separate  estimates  also  combines  the  errors  In  each  of 
those  estimates  and,  In  aggregate  form,  there  Is  no  means  of  evaluating 
the  errors  Involved  or  the  level  of  uncertainty  In  the  estimate. 

However,  where  detailed  cost  data  exists,  the  Industrial  Engineering 
Method  is  the  best  method  for  estimating  costs. 

2.  Parametric  Cost  Estimating:  In  parametric  cost  estimating,  the 
total  cost  of  an  alternative  Is  based  upon  ascribed  physical  and  perfor¬ 
mance  characteristics  and  their  relationships  to  highly  aggregated 
component  costs.  In  other  words,  a  l'-tn-cional  relationship  must  be  set 
up  between  the  total  cost  of  the  alternative  and  the  various  characteristics 
or  parameters  of  the  alternative.  In  the  formal  sense,  the  term  "parameter" 
Is  defined  as  a  cost-related  explanatory  attribute  which  may  assume  various 
values  during  a  particular  calculation.  For  our  purposes,  it  is  best  to 
consider  a  parameter  of  an  alternative  as  a  definable  characteristic  of  that 
alternative;  one  of  the  parts  that  can  be  added  to  give  an  expression  of 
the  value  of  the  whole  system,  device,  or  item.  Parametric  cost  estimating 
is  applicable  to  many  situations  encountered  within  the  DoD;  for  this  reason, 
it  will  be  covered  in  some  detail. 

The  result  of  a  parametric  estimate  depends  directly  upon  the  ability 
of  the  analyst  to  establish  relationships  between  the  attributes  or  elements 
that  make  up  the  alternative.  That  is,  our  first  Job  must  be  to  properly 
choose  and  then  describe  the  cost  influencing  factors  of  the  alternative. 

The  descriptions  of  these  factors  are  called  Cost  Estimating  Relationships 
(CER)  . 

C.  DATA  SOURCES 

Sources  for  linking  the  parameters  of  an  alternative  to  costs  Include: 
expert  opinion,  catalog  prices  by  item,  industrial  engineering  standards, 
cost  estimating  relationships  for  analogous  programs,  and  specific  cost 
estimating  relationships. 

The  data  from  all  these  sources  are  both  historical  and  statistical. 

That  is,  we  will  normally  be  dealing  with  relationships  that  have  been 
established  by  using  statistics  from  the  cost  histories  of  prior  programs. 
Because  of  this,  when  using  cost/parame ter  relationships  we  must  keep  in 
mind  two  tilings:  (1)  the  uncertainty  inherent  in  the  extrapolation  of 
statistics,  and  (2)  whether  the  indicated  relationship  is  logically  sound 
and  reasonable. 

The  first  problem  is  unavoidable.  However,  the  influence  of  the  second 
can  be  diminished  through  careful  checks  of  the  derived  relationships. 

This  can  be  accomplished  through  inspection,  simple  test  data  plots,  or  by 
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more  complicated  techniques  which  involve  looking  at  the  parameter  over  a 
range  of  possible  values.  The  more  complicated  techniques  should  be  left 
to  the  qualified  Cost  Analyst.  However,  obviously  unreasonable  relation¬ 
ships  can  be  intuitively  analyzed  and  corrected.  When  benefit  (for  example, 
greater  speed)  is  inversely  associated  witl  cost,  the  relationship  should 
be  investigated  before  attempting  to  derive  the  predicted  cost  of  the 
alternative . 

D.  DEVELOPING  CERs 

Central  to  any  parametric  analysis  of  cost,  is  the  development  of  valid 
Cost  Estimating  Relationships.  CERs  are  developed  from  the  historical  cost 
of  like  systems  and  the  parameters  (e.g.,  weight,  maximum  speed,  load  capacity) 
of  these  systems.  The  statistical  technique  normally  applied  to  developing 
CERs  from  historical  cost  and  parametric  data  is  called  regression  analysis. 
Regression  analysis  is  primarily  concerned  with  the  determination  of  the 
equation  of  a  line  or  curve  which  will  predict  how  one  variable  (e.g.,  cost) 
will  vary  with  respect  to  some  parameter  (e.g.,  load  capacity). 

The  techniques  of  regression  analysis  are  relatively  sophisticated  and 
should  be  used  only  by  an  individual  familiar  with  statistical  methods. 

For  our  purposes,  it  is  sufficient  to  know  that  after  a  regression  analysis 
is  conducted,  the  statistical  analyst  will  provide  the  manager  with  first, 
and  most  important,  the  estimating  equation,  and  next,  two  measures  of  the 
usefulness  of  this  equation: 

1.  The  standard  error  of  the  estimate.  This  will  show  the  variance 
associated  with  the  prediction  made  from  the  estimating  equation;  it 
expressed  how  useful  the  estimating  equation  is  as  a  tool; 

2.  The  coefficient  of  correlation.  This  will  express  the  closeness 
with  which  one  variable  (e.g.,  load  capacity)  influences  the  other  variable 
(cost)  .  Put  another  way,  it  measures  to  what  extent  the  variation  of  cost 
is  due  to  the  variation  in  load  capacity  or  whether  an  amount  of  the 
variation  in  cost  is  due  to  certain  factors  that  are  not  explained  by  the 
changes  in  load  capacity. 

E.  INGREDIENTS  FOR  PARAMETRIC  ANALYSIS 

We  can  derive  a  parametric  cost  estimate  of  our  alternative  if  we  have: 

1,  The  existence  of  historical  cost/parameter  information  on  like 
systems . 

2.  The  ability  to  predict  with  some  degree  of  likelihood  the  expected 
parameters  of  our  future  alternative;  (e.g.,  weight,  maximum  speed,  or 
payload) . 


3.  A  competent  statistical  analyst  who  can  tell  us  if  the  historical 
costs  of  the  like  systems  do  vary  in  some  defined  way  with  the  chosen 
parameters.  If  they  do,  he  will  give  us  the  estimating  equation. 


12 


PITFALLS 
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Some  factors  to  consider  and  pitfalls  to  be  avoided  when  deriving  or 
reviewing  CERs  are: 

.  Be  aware  of  the  source  of  the  estimate,  and  the  purpose  for  which 
it  is  Intended.  Regardless  of  the  integrity  of  the  Individual  analyst, 
it  should  be  expected  that  some  personal  or  organizational  bias  may  creep 
in.  Contractors  naturally  want  to  sell  their  products  or  services,  and  their 
interests  may  be  served  by  a  high  estimate.  In  this  regard  you  would  have 
an  advantage  if  you  have  a  broad  range  of  historical  cost  data  from  several 
sources  while  the  same  data  may  not  be  available  to  private  contractors. 
Application  of  statistical  analysis  or  simple  analogy  can  give  y 'u  an 
excellent  means  of  checking  estimates  provided  from  other  sources. 

2.  A  simple  check  of  the  equations  used  in  cost  estimating  relation¬ 
ships,  along  with  common  sense,  will  often  indicate  whether  or  not  the 
relationship  is  a  reasonable  one.  The  pitfall  to  be  avoided  is  that  an 
equation  may  adequately  describe  one  sy:  tem  but  not  be  predictive  of 
another. 


3.  Consistency  of  data  is  essential.  When  combining  data  for  a 
regression  sample,  for  instance,  it  is  usually  necessary  to  adjust  dollar 
figures  into  constant  year  dollars.  Because  labor  and  materials  may  have 
not  increased  at  the  same  rate  it  may  be  necessary  to  consider  each 
separately.  If  actual  expenditure  for  equipment  still  in  the  design  state 
will  take  place  in  the  future,  it  may  also  be  necessary  to  c;>nsidvr  infla¬ 
tion  factors.  In  the  area  of  physical  characteristics,  one  must  further 
insure  that  such  common  terms  as  weight,  speed,  and  distance  are  measured 
in  like  units.  Often  conversion  is  necessary  to  be  certain  teat  all  elements 
of  the  sample  are  indeed  compatible. 

A.  Care  must  also  be  taken  to  insure  that  historical  cost  data,  which 
may  be  accumulated  from  several  sources,  truly  reflects  the  actual  costs 
incurred.  Accounting  differences  among  studies  and  contractors  could 
easily  result  in  wide  variations  in  the  costs  actually  included. 

5.  Finally,  do  not  become  so  enamoured  with  an  estimating  model  that 
you  Ignore  the  assumptions  made  in  its  development,  and  the  reliability  of 
the  sample  input  data.  A  computer  will  furnish  an  impressive  <.-d  detailed 
readout,  even  if  the  input  data  is  unreliable.  Carefully  scrutinize  sample 
data,  data  sources,  and  assumptions  made  in  developing  estimating  relation¬ 
ships  . 

G.  JUDGMENT 


In  cases  where  there  are  no  qualified  cost  analysts  available,  or  where 
h*re  is  little  or  no  historical  information  on  the  specific  alternative,  or 


when  Che  cost  estimate  Is  required  so  quickly  that  an  extensive  data  search 
Is  precluded,  we  must  base  our  cost  estimate  entirely  on  experr  judgment. 
Even  In  cases  where  we  have  cost  analysts,  historical  information,  and 
time  available  and  can  adopt  a  formal  method  of  costing,  judgment  must  be 
used  to  r^ach  conclusions  not  directly  supported  by  data.  Expert  judgment 
may  be  i  to  construct  CERs,  or  to  check  their  behavior  when  they  extend 
slgnlfic.  i  ly  beyond  the  data  base,  or  when  the  data  base  Is  too  small  to 
be  statistically  significant. 

A  specialized  method  of  judgment,  called  the  analogy  method,  may  be 
used  to  estimate  costs  by  making  direct  comparisons  with  historical  Infor¬ 
mation  on  like  or  similar  existing  alternatives  or  their  components.  It 
is,  in  fact,  the  most  widely  used  method  of  analysis  to  date,  although  it 
is  surely  not  the  most  accurate.  Hie  major  caution  of  the  analogy  method 
is  that  it  is  basically  a  judgment  process  and,  as  a  consequence,  requires 
a  considerable  amount  of  expertise  if  it  is  to  be  done  successfully.  There 
are  two  types  of  analogues  that  may  be  used.  O.ie  Is  based  upon  similar 
products  and  the  other  upon  similar  concepts.  Similar  products  can  be 
compared  such  as  using  cost  data  on  commercial  aircraft.  Secondly,  when 
a  new  concept  or  system  must  be  costed,  experience  gained  on  a  different 
product  may  be  used.  An  example  of  this  is  estimating  missile  production 
costs  based  on  aircraft  production  experience. 

The  necessity  of  using  experienced  judgment  to  fill  gaps  in  data  has 
long  been  recognized.  In  some  cases  the  majority,  or  even  the  entirety,  of 
our  cost  estimate  must  be  based  upon  judgment.  The  complexity  of  the 
problem,  the  predisposition  of  the  manager,  the  point  of  view  of  the 
analysis,  the  importance  of  the  project  (in  terms  of  both  mission  and 
finances),  and  the  availability  of  qualified  statistical  analysts,  all 
determine  the  extent  of  analysis  necessary.  Hie  keynote  In  using  judgment 
must  be  reasonableness  tempered  with  a  large  dose  of  impartiality. 

Moreover,  judgment  must  always  be  identified  as  what  it  is,  a  guess,  albeit 
an  educated  guess. 

H.  INPUT  -  COST  AND  TIME 

1.  Present  Value:  Most  expenditures  will  be  time  phased.  Since  there 
is  time  value  to  money,  it  is  necessary  to  determine  when  the  expenditure 
for  the  alternative  will  be  made.  Economic  analysis  expands  cost  analysis 
activities  by  examining  the  effects  of  the  time-value  of  money  on  the 
investment  decision.  Once  cost  estimates  have  been  generated,  they  must 
be  time-phased  to  allow  for  alternative  expenditure  patterns.  Hie  time- 
value  of  money  is  considered  by  computing  present  value  costs.  Present 
value  costs  are  computed  by  applying  a  discount  rate  to  the  time-phased 
expenditure  amounts.  Hie  present  value  costs  are  the  sum  total  of  the 
discounted  costs.  The  present  value  of  $100  payable  in  two  years  can  be 
defined  as  the  amount  of  money  necessary  to  invest  today  at  compound 
interest  in  order  to  have  $100  in  two  years.  Hius,  present  value  depends 
on  the  rate  of  interest,  the  frequency  of  compounding,  and  the  time  horizon 
selected. 
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The  present  value  of  the  alternative  is  the  money  cost  which  would  be 
required  to  finance  the  alternative  when  a  specified  percentage  could  be 
earned,  this  then  represents  the  "opportunity  cost”  of  capital.  Assuming 
equal  benefits,  the  alternative  whose  present  value  cost  is  least  is  the 
more  desirable,  because  it  implies  a  more  efficient  allocation  of  resources. 
The  lowest  present  value  cost  means  that  resources  are  allocated  more 
efficiently  in  the  sense  that  fewer  current  resources  must  be  diverted  to 
satisfy  the  requirement. 

The  discounting  technique  requires  an  analyst  to  use  an  interest  rate 
to  discount  future  alternative  costs  to  present  values.  The  present  value 
of  x  dollars  which  will  be  received  at  the  end  of  n  years  from  now  may  be 
computed  by  use  of  the  following  formula: 

P.V.  =  x  1 

TinF- 

where  i  is  the  applicable  intere  t  or  discount  rate. 

It  is  realized  that  present  value  is  being  considered  here  in  much  the 
same  way  that  it  is  considered  in  the  private  sector  of  the  economy.  That 
is,  money  not  expended  on  current  projects  can  be  invested  and  will  yield 
investment  costs.  Some  would  argue  that  the  Government  is  not  a  profit¬ 
making  concern  and  present  value  analysis  is  inapplicable  because  money  not 
immediately  spent  on  one  project  would  be  spent  on  another  and  in  no  case 
could  it  be  saved  as  interest  as  in  the  private  economy.  However,  the 
Federal  Government  as  investor  should  have  as  its  objective  the  maximum 
well-being  of  the  Nation  as  a  whole  as  reflected  in  the  national  Income; 
therfore  no  public  investment  should  be  undertaken  when  it  earns  a  return 
which  is  less  than  the  return  on  the  alternative  use  of  the  funds  which  it 
absorbs . 

The  government  must  determine  the  approximate  value  of  the  money  it 
spends  from  the  private  sector's  savings,  since  those  savings  would  earn 
interest  at  some  rate  if  they  were  not  spent  by  the  Government.  The  Depart¬ 
ment  of  Defense  currently  has  a  10%  discount  rate  established  by  DoDI  7041.3 
to  be  used  in  all  economic  analyses  of  proposed  Defense  investments .  Th i s 
rate  was  determined  by  what  the  decision  makers  felt  would  be  a  fair  and 
honest  approximation  of  the  present  value  rate  for  the  aggregate  of  defense 
investments.  However,  on  any  particular  system  if  the  analyst  feels  that 
an  alternative  discount  rate  would  be  more  applicable,  he  is  at  liberty  to 
prepare  an  analysis  using  the  different  rate,  provided  he  submits  this  as 
a  supplement  to  an  analysis  using  the  prescribed  10'/,  rate. 
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H 

10%  PRESENT  VALUE  TABLE 


TIOJECT 

PRESENT  VALUE 

YEAR 

OF  $1 

1 

0.954 

2 

0.867 

3 

0.788 

4 

0.717 

5 

0.652 

6 

0.592 

7 

0.538 

8 

0.489 

9 

0.445 

10 

0.405 

11 

0.368 

12 

0.334 

13 

0.304 

14 

0.276 

15 

0.251 

16 

0.228 

17 

0.208 

18 

0.189 

19 

0.172 

20 

0.156 

21 

0.142 

22 

0.129 

23 

0.117 

24 

0.107 

25 

0.097 

Table  1 


The  factors  are  bas^d  on  continuous  compounding  of  interest  assuming  uniform 
cash  flows  throughout  the  one-year  period.  These  factors  are  equivalent  to 
an  arithmatic  average  of  beginning  and  end  of  year  compound  amount  factors 
found  in  standard  present  value  tables.  Ten  per  cent  is  used  in  this 
example  since  it  is  the  DoD-established  discount  rate  (DoDI  7041.3). 
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Table  1  lists  the  present  v-,lue  of  capital  over  time  at  10X  discount 
rate.  Careful  analysis  of  this  table  will  make  the  concept  of  present 
value  much  clearer. 

The  value  of  this  technique  is  that  it  can  help  the  decision  ...aker 
evaluate  whether  dimly  perceived  benefits  . re  worth  their  present  and 
future  costs.  The  technique  can  be  helpful  in  making  comparisons  of  the 
costs  of  long-range  programs  that  have  different  time  horizons  but  have 
equal  benefits.  In  focusing  on  cost  profiles  over  time,  discounting  assures 
that  wrong  or  uneconomical  alternatives  are  not  inadvertently  accepted. 

In  discounting,  cost  estimates  are  taken  as  "givens"  and  future  cash 
flows  are  then  made  comparable  in  terms  of  their  present  value.  Of  course, 
to  do  this  it  is  assumed  that  capital  has  a  cost  and  that  the  timing  of 
future  cash  flows  is  an  important  factor  to  consider.  In  short,  discounting 
is  not  a  cost  estimating  technique  in  the  sense  that  it  makes  the  figures 
more  valid  or  accurate  for  the  analysis.  It  is  an  adjustment  to  show  the 
cost  of  capital,  computed  after  the  cost  analysts  use  all  their  techniques 
to  put  their  estimates  together. 

Both  discounted  and  undiscounted  costs  are  useful  for  analysis.  Raw 
(undiscounted)  costs  are  needed  by  the  budgeteers  for  funding  purposes  and 
for  determining  the  obligational  authority  required  to  finance  proposed 
investments.  Present  value  costs  are  necessary  for  making  tradeoff  analyses 
in  project  and  force  level  selection.  Discounting  is  important  for  planning. 

2.  Inflation .  Definitions:  There  has  been  considerable  confusion 
over  the  terms  "constant"  and  "current"  dollars.  The  following  definitions 
are  the  generally  accepted  usage: 

Constant  Year  Dollars  are  always  associated  with  a  base  year  (e.g., 

FY  72  constant  dollars).  An  estimate  is  said  to  be  in  constant  dollars  if 
costs  for  all  work  are  adjusted  so  that  they  reflect  the  level  of  prices 
of  the  base  year.  When  prior  or  future  costs  are  stated  in  constant  dollars, 
the  figures  given  are  adjusted  to  presume  that  the  buying  power  of  the 
dollar  was  the  same  and  will  continue  to  remain  the  same  as  the  base  year. 

Current  Year  or  "Then  Year"  dollars  are  current  to  the  year  the  work 
is  performed.  When  prior  costs  are  stated  in  current  year  dollars,  the 
figures  given  are  the  actual  amounts  paid  out.  When  future  costs  are 
stated  in  c  irrent  year  dollars,  the  figures  given  are  the  actual  amounts 
which  will  be  paid  including  any  amount  due  to  future  price  changes.  When 
making  future  estimates,  it  is  necessary  to  initially  assume  a  base  buying 
power  for  each  dollar  (constant  dollars)  and  then  apply  an  escalating 
factor  for  inflation  which  converts  our  estimate  into  current  year  dollars. 
The  "current  year"  in  "current  year  dollars"  does  not  refer  to  the  year  in 
which  the  estimate  is  made  or  any  other  single  year. 
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The  use  of  constant  dollars  In  budget  requests  has  two  major  benefits. 
First,  constant  dollars  may  be  useful  In  the  consideration  of  resource 
requ  remen ts  over  time.  Here,  the  use  of  constant  dollars  removes  distor¬ 
tions  which  are  attributable  only  to  price  level  changes.  Second,  using 
constant  dollars  aids  in  the  attempt  to  control  inflation  since  the  expec¬ 
tation  that  inflation  will  continue  adds  substantially  to  inflationary 
pressure , 

When  inflation  occurs  between  the  time  a  budget  request  is  submitted 
and  the  time  funds  are  actually  expended,  there  will  be  a  gap  between  how 
far  the  funds  were  supposed  to  go  and  how  far  they  actually  go.  Hence,  the 
use  of  current  dollars  also  has  certain  advantages  for  use  in  budget  and 
programming  documents.  A  major  advantage  is  in  developing  estimates  which 
more  realistically  reflect  likely  expenditures  levels.  Since  cost  estimates 
have  been  proven  overly  optimistic  in  the  past,  inflated  estimates  can 
serve  to  reduce  overruns  by  showing  more  realistic  initial  estimates. 

Only  limited  policy  guidance  on  inflation  has  been  announced  to  date. 

DoD  is  making  increasing  use  of  current  dollars  in  its  internal  planning 
process.  General  instructions  have  been  issued  by  DoD  for  presentation  of 
price  estimates  for  research  and  development,  procurement,  and  construction. 
This  policy  is  broadly  summarized  below: 

(a)  DoDI  7045.10,  "Five  Year  Defense  Program  Procurement  Annex," 

14  April  1970.  This  instruction  applies  to  cost  estimates  appearing  on 
the  Five  Year  Defense  Program  (FYDP),  the  budget,  Development  Concept 
Papers  (DCP) ,  Selected  Acquisition  Reports  (SAR) ,  the  Program  Objectives 
Memorandum  (POM),  and  related  items.  Specific  implementing  instructions 
for  these  documents  will  be  provided  by  DoD  agencies  and  components  as 
appropriate. 

(b)  DoD  Manual  7110. 1-M,  "Budget  Guidance  Manual,”  dated  1  July  1971, 
as  changed  15  August  1972. 

(c)  OASD(C)  Memorandum,  30  June  1971,  Subj:  Weapon  System  Costing. 

Aside  from  these  general  instructions,  there  exists  no  approved  proce¬ 
dure  for  handling  inflation.  However,  the  cnalyst  must  be  aware  that  it 
does  exist  and  try  to  deal  with  it  consistently  when  costing  each  of  his 
alternatives . 

3.  Cncertalnty  and  Risk  in  Cost  Estimating.  In  making  capital  expendi¬ 
ture  decisions,  top  management  is  faced  with  the  difficulty  of  evaluating 
assumptions  which  involve  uncertainty. 

What  is  meant  by  uncertainty?  A  useful  distinction  is  made  in  cost 
analysis  between  requirements  uncertainty  a.  d  cost-estimating  uncertainty. 
The  former  causes  variations  In  cost  estimates  stemming  from  changes  in  the 
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configuration  of  the  alternative  being  analyzed,  while  the  latter  has  to  do 
with  variations  in  cost  estimates  where  the  configuration  cf  the  system  or 
force  is  essentially  constant. 

requirements  uncertainty  is  most  noticed  in  the  development  of  new 
systems.  That  is,  when  a  new  system  is  conceived,  its  preliminary  design 
seldom  turns  out  to  be  very  similar  to  the  final  design.  Early  estimates 
of  cost  for  those  systems  have  historically  relied  heavily  upon  the  preli¬ 
minary  design  information.  It  follows  from  this  that  if  preliminary 
characteristics  are  in  error,  cost  estimates  relying  on  this  information 
will  also  be  in  error. 

The  alternatives  analyzed  at  unit  level  will  not  usually  involve 
design  considerations  and  their  characteristics  do  remain  constant.  However, 
a  cost  estimate  is  still  likely  to  contain  error  because  cost  estimating 
relationships  (CERs)  cannot  be  assumed  to  hold  exactly.  This  means  that 
in  estimating  a  certain  cost  component  as  a  function  of  some  variable  or 
variables,  it  is  foolhardy  to  believe  that  the  variables  predict  the 
particular  cost  with  certainty. 

There  are  other  reasons  why  ccst  estimates  may  be  incorrect.  For 
example,  errors  may  be  introduced  when  one  is  forced  to  extrapolate  beyond 
the  range  of  the  sample  or  data  base  from  which  the  estimating  relationship 
is  derived.  Errors  are  sometimes  introduced  by  adopting  different  ground 
rules.  Examples  include  the  use  of  different  discount  rates,  the  use  of  different 
price  rates,  and  the  use  of  different  price  levels  expected  to  prevail  in  future 
years . 

Cost  sensitivity  analysis  is  the  method  most  used  in  dealing  with 
uncertainty.  Both  requirements  uncertainty  and  cost-estimating 
uncertainty  can  be  dealt  with  by  using  this  technique.  For  requirements 
uncertainty,  the  analysis  will  provide  a  range  of  cost  estimates  for  future 
systems  that  ha'’C  uncertain  ultimate  configuration  characteristics.  For 
cost  estimating  uncertainty,  the  analysis  can  show  the  sensitivity  of 
total  cost  to  particular  uncertain  aspects  of  the  total  system.  The  basic 
procedure  of  the  analysis  is  to  vary  the  assumptions  regarding  major  para¬ 
meters  and  then  test  the  sensitivity  of  costs  to  these  changed  assumptions. 

For  example.  If  an  analysis  indicates  that  program  one  is  preferable  to 
program  two,  a  sensitivity  analysis  could  be  performed  by  increasing  a  factor 
such  as  the  size  of  the  group  to  which  the  programs  are  directed  and  then 
examining  the  results  of  the  analysis  under  this  change. 

Although  often  useful,  sensitivity  analysis  has  its  limitations. 

It  does  not  provide  the  basis  for  making  probability  statements  about  the 
cost  estimate,  and  there  is  no  guarantee  that  the  analysis  will  include 
all  the  relevant  alternatives.  However,  despite  all  this,  cost  sensitivity 
analysis  is  perhaps  the  most  commonly  used  technique  for  dealing  with  the 
problem  of  uncertainty  in  cost  analysis  of  future  systems  and  force. 
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The  terms  uncertainty  and  risk  are  often  used  interchangeably,  although 
a  distinction  can  be  drawn  by  noting  that  the  concept  of  risk  deals  with 
measurable  probabilities  while  the  concept  of  uncertainty  does  not. 

An  event  is  risky  where  a  probability  distribution  can  be  ascertained.  An 
event  is  uncertain  when  no  probabilities  can  be  developed  concerning  that 
event.  Many  statistical  tools  (e.g.,  probability  theory,  game  theory,  Monte 
Carlo  technique,  Delphi  technique,  decision  trees,  etc.)  exist  so  that  a 
quantifiable  risk  assessment  may  be  made. 

4.  Sunk  Costs  and  Incremental  Costs.  If  costs  have  been  incurred  as 
a  result  of  past  decisions  they  are  known  as  "sunk  costs."  Sunk  costs 
should  not  be  included  in  our  cost  calculations.  Once  a  decision  has  been 
made  which  causes  costs  to  be  incurred,  those  costs  are  beyond  the  control 
of  the  current  decision.  Sunk  costs  no  longer  represent  any  alternative 
for  the  decision  maker  and,  if  included,  would  only  confuse  the  derision 
making  problem.  Hie  analyst  should  present  only  the  future  cost  or  "incre¬ 
mental  cost"  of  each  alternative.  These  are  those  increments  of  cost  that 
will  be  incurred  as  the  result  of  choosing  one  or  another  of  the  alternatives 
available.  They  may  be  looked  upon  as  "consequential  costs"  since  they  are 
the  consequences  of  the  decision  makers  current  choice. 


OUTPUT  -  JUDGING  BENEFIT 


CHAPTER  IV  - 
A.  PREFACE 

The  objective  of  this  chapter  Is  to  discuss  the  basic  considerations 
required  to  present  (to  the  appropriate  decision  maker)  an  orderly,  com¬ 
prehensive  and  meaningful  display  of  all  returns  (outputs,  benefits,  yields, 
worth)  expected  for  each  alternative  within  the  scope  of  the  economic 
analysis  under  consideration.  The  returns  ot  each  alternative  should  be 
expressed  so  that  the  decision  maker  is  able  to  compare  the  various  alter¬ 
natives  of  the  economic  analysis.  (For  purposes  of  this  handbook,  the 
term  "benefits"  is  used  as  the  overall  term  for  returns  (output,  products, 
services,  yields,  worth).) 

By  referring  to  the  Chart,  "The  Process,"  you  will  note  the  position 
ol  our  objective  in  the  Economic  Analysis  Process  shown  as  4.b.,  "Determine 
Beiefits."  This  display  assists  us  in  focusing  on  the  broad  nature  of 
the  benefit  determination  effort  and  gives  a  better  understanding  of  the 
role  that  those  determinations  must  play  in  deciding  between  alternatives. 

General  aids  which  apply  to  all  analyses  and  which  will  be  dealt  with 
more  fully  in  the  "Procedures"  section  of  this  chapter  are: 

1.  Use  a  systematic  procedure  to  establish  returns  in  order  to 
minimize  strictly  subjective  judgment. 

2.  Discover  and  record  all  the  benefits,  whether  or  not  quantifiable, 
relevant  for  each  of  the  alternatives  developed  in  Item  2  of  "The  Process." 

3.  Express,  If  possible,  the  returns  of  each  alternative  in  terms  of 
a  common  denominator  or  a  score. 

4.  Arrange  returns  according  to  some  hierarchy  of  values  if  a  common 
denominator  not  available. 

The  consistency  and  relevance  of  the  benefits  available  must  be 
carefully  examined.  An  existing  measure  with  which  management  is  familiar 
has  certain  advantages  in  regard  to  ready  acceptance  as  a  benchmark,  but 
it  may  not  be  relevant  throughout  the  entire  range  of  the  study.  The 
analyst  should  be  as  cautious  in  accepting  a  benefit  measure  just  because 
it's  there  as  he  should  be  in  Introducing  a  new  untried  one  that  simply 
accommodates  only  an  aspect  of  his  study.  The  output  information  effort 
inder  DoD  Instruction  7045.11,  "Improvement  and  Use  of  Output  Information 
n  the  Department  of  Defense  Programming,  Planning,  and  Budgeting  System," 
lated  December  17,  1970,  and  DoD  Directive  5010.15,  "Defense  Integrated  Management 
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Engineering  System,"  dated  January  13,  1972,  should  be  studied.  Additional 
literature  in  this  area  of  analysis  is  available  and  is  being  compiled  into 
a  bibliography. 

The  Process  chart  indicates  that  in  Items  1,2  and  3  of  any  Economic 
Analysis:  (a)  the  objectives  of  the  study  are  defined  in  detail,  (b)  the 

alternatives  or  solutions  to  meet  the  objectives  are  provided,  and  (c)  the 
assumptions  are  formulated.  We  are  then  ready  to  determine  the  costs  and 
benefits  related  to  each  of  the  alternatives  as  spelled  out  for  the  parti¬ 
cular  economic  analysis.  This  chapter  will  attempt  to  outline  hew  we  go 
about  determining  the  benefits  of  each  of  the  options  we  feel  could  meet  the 
objectives  of  the  economic  analysis  problem.  It  is  best,  because  of  the 
state  of  the  art,  that  only  an  overall  methodological  approach  be  used  to 
guide  our  practitioner. 

The  following  suggested  Step-by-Step  Procedure  will  greatly  facilitate 
objective  benefit  determination. 


Step  I 
Step  II 
Step  III 
Step  IV 


Determine,  List  and  Define  Relevant  Benefits. 

Establish  Sources  of  Information  for  Benefit  Determination. 

Collect  and  Display  Information  for  Benefit  Determination. 

Summarize,  Evaluate  and  Present  Benefit  Determination  for 
Alternatives  of  the  Economic  Analysis. 


B.  PROCEDURES 


1 .  Determine  and  Define  the  Benefits  Relevant  for  each  of  the  Alter¬ 
natives  of  the  Economic  Analysis. 

a.  Determine  and  list  the  benefits  of  each  alternative  —  whether 
the  benefit  is  thought  to  be  potentially  quantifiable  or  not  quantifiable. 
List  all  benefits  which  may  possibly  shed  light  on  the  economic  analysis 
alternatives.  It  is  quite  possible  that  some  of  the  benefits  listed  in  this 
first  attempt  will  eventually  be  discarded  and  others  becoming  evident 
further  on  in  the  analysis  will  be  added  to  the  list.  For  instance,  if  one 
method  causes  ten  items  to  be  produced  and  only  two  are  needed,  the  greater 
productive  capacity  of  this  system  may  not  be  a  plus  factor.  Other  consi¬ 
derations  rjay  come  into  play  such  as  availability  of  storage  space,  cost  of 
storage,  obsolescence,  etc. 


b.  Define  each  benefit  in  relation  to  its  respective  alternative  in 
the  economic  analysis.  Describe  each  return  as  well  as  you  can  at  this  step 
Remember  that  at  any  point  in  the  Benefit  Determination  Procedure,  new  or 
previously  unrecognized  evidence  may  cause  us  to  go  back  and  retrace  any  one 
or  several  steps  of  the  procedure. 
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During  this  process  consideration  should  be  given  to  the  level 
of  decision  of  the  economic  analysis.  For  example:  Let  us  assume  that  in  a 
five-man  warehouse  at  an  installation,  we  store  spare  parts  on  seven  shelves. 

We  are  considering  decreasing  the  layers  of  vertical  shelving  in  order  to 
obtain  greater  warehouse  efficiency.  Instead  of  having  seven  shelves,  the 
items  will  be  stored  on  five  shelves  so  that  all  items  will  be  accessible 
without  using  ladders  (ladder  is  now  used  when  pulling  material  from  the  two 
top  shelves).  (Although  there  may  be  other  alternatives  for  this  problem, 
such  as  mechanization,  we  will  restrict  ourselves  for  illustrative  purposes.) 

In  this  case,  the  decision  could  be  made  by  the  local  operating  official 
and  benefits  related  to  economic  effects  on  the  community  (if  any)  would  not 
be  germane;  however,  benefits  related  to  customer  service,  employee  morale, 
safety,  etc.,  could  well  be  considered. 

However,  if  the  investment  is  a  large  one,  such  as  whether  or 
not  to  consolidate  field  activities  or  buy  some  special  equipment,  the 
decision  may  be  at  the  Service  level  (and  in  some  cases,  probably,  at  the 
OSD  level).  In  such  cases,  benefit  determination  related  to  the  economics 
of  the  community  could  be  one  of  the  determinants  for  selecting  a  parti¬ 
cular  alternative. 

Each  situation  must  be  dealt  with  within  the  context  of  the 
total  economic  analysis  under  study. 

There  is  no  check  list  available  with  which  to  ascertain  that  all 
output  returns  for  an  alternative  of  an  economic  analysis  have  been  included 
in  the  benefit  determination,  and  that  all  are  valid  for  the  particular 
situation.  Hwever,  in  order  to  assist  the  analyst  in  selecting  benefits 
germane  to  the  study  and,  hopefully,  in  excluding  spuriously  related  and 
nonsignificant  information  for  the  decision  maker,  characteristics  such  as 
the  following  could  be  reviewed  when  listing  and  defining  benefits: 

Discreteness :  Is  the  benefit  clearly  and  concisely  identifiable 

from  all  of  the  other  benefits?  Does  it  overlap  with  any  other  measure?  Is 
it  duplicated?  Maintain  as  separate  an  entity  as  is  possible. 

Quantification:  Is  the  benefit  directly /indirectly  measurable 

using  valid  techniques  available  from  the  various  disciplines  used  in 
analysis?  If  not,  can  some  method  for  comparability  be  used?  If  quantifi¬ 
cation  is  not  possible,  can  other  techniques  such  as  ranking,  etc.,  be  used  for 
decision  purposes?  Quantification  is  by  no  means  essential  for  output 
information  to  be  useful  for  analytical  purposes,  although  precision  and 
specificity  are  needed  to  the  greatest  feasible  degree. 

Discriminative :  Is  the  benefit  related  to  the  alternative  of 

the  economic  analysis?  Is  it  discriminating  in  relation  to  the  objective 
of  the  decision  maker?  Is  it  spuriously  related  to  the  purposes  of  the 
decision  and  should  therefore  be  excluded? 
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Also,  we  will  find  that  the  benefits  expected  of  any  alternative 
may  fall  into  various  "categories”  depending  on  the  kind  of  program,  systems, 
operation,  organization,  etc.,  that  has  been  submitted  for  economic  analysis. 
Terminology  used  for  these  categories  is  generally  descriptive  of  the 
benefits  Included.  These  are  not  intended  as  definitive,  but  as  guides  to 
the  analyst  in  the  effort  to  Include  all  benefits  related  to  an  alternative. 

It  should  also  be  cautioned  that  the  list  is  not  intended  to  be  all  Inclusive; 
it  is  only  illustrative  of  some  of  the  types  of  benefit  categories  that 
could  be  applicable  depending  on  the  problem.  Some  of  the  categories  under 
which  benefits  appear  are: 

(1)  Production:  Number  of  commodities  or  items  produced  for 
each  alternative.  For  example:  Number  of  meals  served,  hours  flown, 
components  manufactured.  This  could  be  related  to  comparable  time  periods 
of  the  economic  analysis  (as  in  productivity). 

(2)  Productivity:  (related  to  staffing  benefits)  number  of 
items  per  manhour,  volume  output  related  to  manhours. 

(3)  Operating  Efficiency:  At  what  rate  does  the  system  consume 
resources  to  achieve  its  output?  For  example,  miles  per  gallon,  copies  per 
kilowatt  hour,  mean  days  per  shipment. 

(4)  Reliability:  This  describes  the  system  in  terms  of  its 
probable  failure  rate.  Useful  measures  may  be  mean-time-between-failure , 

the  number  of  service  calls  per  year,  percent  refusals  per  warehouse  requests. 

(5)  Accuracy:  What  is  error  rate?  Measure  errors  per  operating 
time  period.  N<imber  of  errors  per  card  punched,  errors  per  hundred  records, 
errors  per  100  items  produced,  etc. 

(6)  Maintainability/Controllability:  Has  adequate  human 
engineering  been  performed?  Is  the  system  compatible  with  adequately 
trained  crew  members?  When  the  system  does  fail,  is  it  difficult  to 
repair  because  of  poor  accessabillty?  A  useful  measure  could  be  based  on 
the  average  manhours  necessary  for  repairs  over  a  given  time  period,  i.e., 
downtime,  or  the  crew  rate  necessary  to  control  and  maintain  the  system. 

(7)  Manageability:  Consider  how  the  workload  of  the  organization 
will  be  affected  by  Increased  or  decreased  supervision  or  inspection  time 

as  a  result  of  the  system.  Man-days  could  be  used  as  a  measure;  difference 
in  kind  of  personnel  might  be  a  factor  as  well  as  availability  of  type  needed. 

(8)  Integratablllty :  Consider  how  the  workload  and  product  of 
the  organization  will  be  affected  by  the  changes  necessitated  in  modification 
of  existing  facilities  or  equipment,  technical  data  requirements,  initial 
personnel  training,  warehouse  space  for  raw  goods  or  parts  storage,  etc. 
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(9)  Availability:  When  can  each  system  be  delivered/implemented; 
when  is  it  needed  to  meet  proposed  output  schedules?  What  is  the  lead  time 
for  spare  parts  delivery? 

(10)  Service  Life:  Consider  hew  long  the  proposed  system  will 
affect  the  organization's  workload  or  output.  What  about  obsolescence? 

(11)  Quality:  Will  a  better  quality  product/service  be  obtained? 
Could  quality  be  graded,  thus  measurable?  If  not,  a  description  of  improve¬ 
ment  could  be  given.  What  is  the  impact  of  the  varied  quality? 

(12)  Acceptability:  Consider  the  alternative  in  terms  of 
whether  it  may  interfere  with  the  operation  of  parallel  organizations  or 
the  operation  of  prerogatives  of  higher  echelon  organizations. 

(13)  Ecology:  Consider  the  ecological  aspects  of  each  alter¬ 
native.  What  are  the  current  legislative  requirements? 

(14)  Economic:  Consider  employment  benefits,  DoD  small  business 
obligations,  economically  depressed  area  relationships,  legislative  require¬ 
ments  . 

(15)  Morale:  Employee  morale.  This  could  be  measured  by  an 
opinion  sample  survey. 

(16)  Safety:  Number  of  accidents,  hazards  involved. 

(17)  Security:  Is  security  built  in?  Will  more  precautions 
be  needed?  More  guards?  Are  thefts  more  likely? 

Pertinent  benefit  categories  will  become  evident  as  the  analysis 
of  the  alternatives  is  performed.  The  benefits,  of  course,  will  be  defined/ 
described  in  accordance  with  the  requirements  of  each  alternative  under 
review . 

2 .  Determine  Sources  of  Information  for  Benefits  listed  in  Step  1. 
a.  Separate  the  Benefits  defined  in  Step  1  into  two  lists  as 

follows: 

List  I.  Benefits  where  Back-Up  Information  is  Available. 

Benefits  for  which  information  in  usable  form  is  easily  obtain¬ 
able.  Next  to  each  benefit  listed,  indicate  source  of  information,  in  what 
form  it  is  available,  and  In  general  terms,  next  to  each  benefit,  how  you 
propose  to  gather  the  needed  information  and  the  feasibility  of  doing  so. 

Should  the  analyst  decide  that  obtaining  the  needed  information  is  impractical, 
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for  whatever  reason,  he  should  be  able  to  support  his  position.  This  step 
applies  to  benefits  which  may  be  quantifiable  as  well  as  for  those  which  do 
not  seem  quantifiable.  It  is  best  to  obtain  the  maximum  amount  of  infor¬ 
mation  in  estimating  parameters.  However,  this  may  not  always  be  feasible. 

For  example,  if  in  Step  1  you  have  listed  "Production  of  an 
Item,"  check  actual  data  available  to  see  if  there  are  weeks,  years,  etc., 
of  production  records  with  data  which  could  be  used  for  actual  production 
and  estimating  purposes  when  valid  statistical  or  other  analytical  techniques 
are  used.  If  the  immediate  organization  does  not  have  such  information, 
is  It  available  for  a  comparable  organization?  Is  prototype  data  available, 
etc.  The  statistician,  mathematician,  industrial  engineer,  etc.,  will 
be  helpful  in  determining  whether  there  are  techniques  available  in  the 
relevant  disciplines  that  can  be  applied  to  substantive  information  in  order 
to  obtain  the  benefit  determination  needed  for  the  economic  analysis.  (Applying 
various  techniques  to  data  already  in  the  system  could  preclude  the  cost  and 
time  needed  to  gather  additional  data.) 

For  benefits  not  quantifiable  even  by  ranking,  rating,  or 
related  methods,  list  any  appropriate  available  and  reliable  sources  for 
narrative  detail  or  use  experience  judgment  sources. 

List  II.  Benefits  for  Which  Back-Up  Information  is  not 

Available. 


For  the  remaining  benefits,  or  chose  for  which  no  information 
sources  have  been  readily  identified,  the  analyst  will  have  to  do  some 
research  in  deciding  how  to  obtain  information  for  his  benefit  determination. 
Indicate  next  to  each  benefit  the  method  proposed  in  order  to  obtain  infor¬ 
mation. 


In  these  instances,  information  may  have  to  be  obtained  by 
conducting  a  100  percent  collection  of  relevant  data  for  the  benefit  in 
question,  a  sample  survey  may  be  possible  for  obtaining  data,  field  trips 
by  experts  conferring  with  experts  may  be  needed,  specialized  libraries 
may  serve  as  sources  for  relevant  input,  and  other  public  agencies  or  private 
firms  and  institutions  could  prove  helpful.  The  specific  circumstance 
will  decide  the  process. 

As  examples  of  what  is  meant  by  benefits  for  which  information 
may  not  readily  be  available,  we  cite  benefits  such  as  morale  of  personnel, 
safety  of  an  operation,  etc.  In  these  instances,  a  statistical  sample  could 
be  used  to  produce  the  data  for  the  system  at  hand  and  could  be  used  as 
benchmark  statistics  for  the  related  alternatives  and  for  projection  purposes. 
For  a  weapons  system  where  data  may  not  be  available,  a  combination  of  parts 
of  existing  systems  may  serve  the  same  purpose. 


26 


£ 

?■ 

t 


With  the  completion  of  Step  2  of  this  procedure,  the  analyst 

should  have: 

a.  Identified  and  defined  or  described  the  benefits  resulting 
from  each  alternative  required  in  the  particular  economic  analysis. 

b.  Sources  of  information  and/or  methods  for  obtaining  the 
information  for  each  benefit. 

We  can  new  proceed  to  Step  3. 

3.  Collection  of  Information  for  Benefit  Determination 


a.  Organize  the  method  for  collecting  information  for  each  benefit, 
collect  the  applicable  data,  and  record  the  information  for  each  alternative 
of  the  economic  analysis. 

b.  It  must  again  be  emphasized  that  both  the  subject  matter 
specialist  and  the  individual  kntwledgeahle  in  the  disciplines  concerned 
with  formulating  quantifiable  and  nonquantifiable  outputs  for  analysis 
purposes  must  cooperate  if  adequate  usable  benefit  determinations  are  to  be 
established. 


c.  At  this  point,  the  information  collected  can  be  recorded  simply 
by  listing  the  information  for  each  benefit,  in  tabular  form,  similar  to  the 
following  display.  (At  this  point,  there  is  no  need  to  be  concerned  about 


scoring,  ranking  or  establishing  any  hierarchy  of  values,  since  this  will  be 
the  thrust  of  Step  IV.) 


Benefits 

Mode  of 
Appraisal 
(Whether  or 

Not 

Quantified) 

Alt.  I 

Alt.  II 

Alt.  Ill 

Years  of 

i  Alternative  Life 

Years  of 

Alternative  Life 

Etc. 

1 

2 

3 

4 

1 

2 

3 

4 

1.  Production 

Items  per  hour 

2.  Customer 

Satisfaction 


X  served  on 
time 


3.  Safety 


4.  Morale 


5.  Quality 


It  of  acci¬ 
dents  per 
employee 

Narrative  and/ 
or  ranking  (re¬ 
action  of  com¬ 
munity  to  system 
planned)  Good  (1), 

Poor  (2),  Indifferent  (3) 

Errors  per  record 


After  Step  3  has  been  completed,  it  would  be  beneficial  for  the 
analyst  to  review  what  has  been  done  to  see  whether  benefits  should  be 
added/deleted,  whether  more  relevant  yardsticks  for  the  associated  benefits 
could  be  designated,  whether  with  greater  imagination  and  use  of  analytical 
techniques  available,  more  adequate  benefits  and  benefit  measures  could  be 
produced  for  the  decision  maker's  understanding  and  consideration. 

4 .  Summarization,  Evaluation  and  Presentation  of  Benefits 

In  order  for  benefit  determination  to  be  of  value  for  decision 
maker,  comparative  visibility  of  the  benefits  of  each  alternative  is 
necessary.  A  generalized  format,  Tables  1  and  2  following,  which  should, 
of  course,  be  varied  to  fit  the  specific  situation,  is  shown  for  discussion 
purposes.  Hie  exact  method  of  comparison  and  the  tools  and  techn'quec  to 
be  used  must  be  left  to  the  analyst  in  conjunction  with  the  subject  matter 
and  professional  analytical  personnel  since  proper  "weighing,"  quantitative 
and  nonquantitative  comparisons  and  over-all  scoring  of  system  dimensions 
will  vary  with  different  systems,  organizations,  programs,  etc.,  being 
studied  in  the  economic  analysis. 

Many  techniques  are  available  for  comparing  quantifiable  benefits. 
Some  which  have  been  used  include  graphic  analysis,  regression  analysis, 
indexing,  decision  theory,  marginal  analysis,  ratios,  linear  programming, 
mathematical  and  economic  statistical  modeling.  Nonquantifiable  benefits 
may  be  analyzed  by  using  certain  nonparametric  statistical  techniques. 

A  possible  technique  for  weighing  benefits  might  be  a  polling  technique 
such  as  the  Delphi  method. 

In  this  step,  array  the  benefits  and  their  respective  data  in  order 
of  significance  of  each  benefit  to  the  problem  objective.  Then,  where 
possible,  combine  benefits  to  give  a  composite  score  for  each  alternative. 

In  some  problems,  it  may  even  be  possible  to  calculate  a  score  for  the 
total  alternative  directly  if  data  are  in  the  same  units.  In  any  event, 
such  consolidation  will  assist  in  the  decision  making  process  since  it 
reduces  some  of  the  detail;  however,  the  detail  information  for  the 
individual  benefits  should  be  accessible.  For  example,  in  order  to 
measure  the  benefit  of  different  warehouse  processes,  it  may  be  feasible 
to  measure  the  warehouse's  receiving  and  storing  functions.  Since  receiving 
is  recorded  in  line  items  and  storing  in  measurement  tons,  it  is  possible 
to  combine  the  two  using  a  weighted  index  with  respective  manhours  for  each 
function  as  weights.  Alternative  I  warehouse  benefit  would  then  be  equated 
with  base  100  and  variation  from  this  could  be  on  par,  better,  or  worse 
for  other  alternatives  depending  on  the  weighted  index  calculated  from  the 
estimated  or  actual  data. 

Another  method  of  composite  scoring  would  be  to  convert  actual 
output  to  some  common  factor  such  as  dollars.  In  so  doing,  we  implicitly 
assign  to  each  benefit  a  portion  of  the  worth  of  the  combined  alternative 
benefits.  For  instance,  we  can  predict  an  expected  yearly  repair  cost  based 
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on  the  mean-time-between-failure  and  average  maintenance  downtime  for  each 
alternative.  In  converting  to  dollars,  care  should  be  taken  in  the  mathe¬ 
matical  relationship  between  the  cost  side  of  each  alternative  and  the  cost 
conversions  on  the  output/benefit  side  of  the  equation. 

The  most  significant  problem  in  determining  overall  technical  and 
logistical  competence  of  a  system  is  deciding  upon  the  proper  weights  to 
be  given  to  the  various  benefits.  When  objective  inherent  weights  of 
the  system,  such  as  relative  manhours,  dollars,  etc.,  are  not  available, 
the  criteria  for  weighting  should  be  based  on  hew  much  each  contributes 
to  the  accomplishment  of  problem  requirements,  i.e.,  the  economic  analysis 
problem  under  consideration. 

In  situations  where  it  is  difficult  to  project  benefits  and/or  to 
compute  measures,  it  is  desirable  to  provide  as  much  useful  information  as 
possible  to  enable  a  decision  to  be  made  as  to  which  alternative  yields 
the  most  benefits. 

A  composite  of  total  worth  or  value  of  a  system  is  not  always  possible 
by  objective  quantitative  scoring  or  weighting.  The  comparison  format, 
with  composites  as  subtotals  of  individual  benefit  statistics,  will  allow 
for  appraisal  by  experts  and  final  review  by  the  decision  maker. 

TABLE  1 

SAMPLES  OF  BENEFIT  DETERMINATION  DISPLAYS 


Mode  of 

Benefits  Appraisal  _ Alternatives 


(In 

order  of  significance) 

and/or 

Measurement 

i 

All  Years 

II 

All  Years 

A. 

Quantifiable  Benefits 

1. 

Productivity 

If  of  line  items  per 
manhour 

100 

50 

2. 

Accuracy  in  opera¬ 
tion 

Stockpicker  errors 
per  1000  line  items 
issued 

12 

6 

3. 

Customer  Satis¬ 
faction 

%  shipped  on  time 

70  Z 

90Z 

4. 

Safety 

Employee  accidents 
per  year 

3 

1 

(Composite  Score  -  if  possible) 


TABLE  1 


SAMPLES  OF  BENEFIT  DETERMINATION  DISPLAYS 


Mode  of 


Benefits  Appraisal _ Al  tematives 


(In  order  of  significance) 

and/or 

Measurement 

I 

All  Years 

II 

All  Years 

B.  Nonquant if lab le 


1.  Morale  Concensus  of  em-  Climbing  lad-  Desirable 


ployee  opinions 

ders  is  not 
deslrab le; 
wastes  energy. 

since  mater¬ 
ial  easier 
to  reach  and 
energy  con¬ 
served,  less 
ti  ing. 

TABLE  2 

Benefit 
(In  order  of 
significance) 

Mode  of 
Appraisal 

•'Alt.  I 
All  Years 

*Alt.  II 
All  Years 

*Alt.  Ill 
All  Years 

A.  Quantifiable 

1. 

Start  of 
delivery  of 
product 

Contract 

Specification 

In  Process 
10/71 

12/71 

12/71 

2. 

Production 

Units  per  mo. 

100 

75 

150 

3. 

Durability 

Temp.  Operat¬ 
ing  range 

40-80  deg. 

40-80  deg 

50-75  deg. 

4. 

Maintenance 

Av.  Malnt. 
Manhours  per 
repair  (Con¬ 
tract  Specs) 

13 

10 

10 

Composite  Score  -  if  possible 


B.  Nonquant if lab le 


1.  Economic 
Impact 


Expert 

Judgment 


Retention  will 
maintain  em¬ 
ployment  in 
area.  Other¬ 
wise  other 
work  wi 11  be 
needed . 


No  need  for 
new  work  to 
maintain  em¬ 
ployment  which 
is  at  healthy 
level. 


Economically 
depressed 
area . 

Employment 
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TABLE  2 

Benefit 

(In  order  of 

Mode  of 

*Alt.  I 

*Alt.  II 

*Alt.  Ill 

significance 

Appraisal 

All  Years 

All  Years 

All  Years 

B.  Nonquantif  iable 


2.  Quality 

Contract 

All  Government 

Contractor 

Total  Con¬ 

Control 

Specifica¬ 

Inspectors . 

Inspected, 

tractors 

(Inspection) 

tion 

followed  by 
limited 
Government 
inspection. 

Inspected. 

*If  benefit  data  change  with  year,  detail  for  each  year;  otherwise  give  total 
length  of  life  for  each  alternative. 


COMPARING  ALTERNATIVES 


CHAPTER  V  - 
A .  PREFACE 


Now  that  the  costs  and  benefits  of  each  of  the  proposed  alternatives 
have  been  quantified,  it  is  possible  to  analyze  them  side  by  side,  present 
this  analysis  in  a  useful  format,  and  finally,  select  the  preferred  alter¬ 
native  . 

Up  to  this  point,  we  have  concentrated  on  determining  the  cost  and 
benefit  of  discrete,  non-divisib le  alternative  systems.  However,  we 
normally  deal  with  more  than  a  single  discrete  system  within  each  alter¬ 
native  proposal.  For  example,  a  quantity  of  a  certain  type  of  aircraft 
or  school  bus,  will  normally  give  us  a  greater  level  of  effectiveness 
than  a  smaller  quantity.  We  must  new  study  a  continuum  of  cost  and  continuun 
of  benefit  so  that  we  may  determine  in  what  manner  benefit  will  vary  with 
cost  and  vice  versa. 

Hie  proposed  method  of  comparison  of  alternatives  (see  Chart  page  33) 
employs  a  graphic  format.  It  should  be  emphasized  that  graphic  analysis 
is  not  necessarily  a  substitute  for  mathematical  calculations  which  rank 
the  proposals.  Rather,  this  format  serves  to  display  the  results  of 
computations  in  a  manner  which  is  easily  understood  when  we  have  a  continuum 
of  cost  and  effectiveness  measures.  Using  graphs  serves  two  functions. 

First,  the  graphs  may  suggest  the  appropriate  ranking  of  the  alternatives 
over  a  given  range  of  time  or  effectiveness,  thus  performing  an  analytic 
function.  Second,  the  use  of  a  graph  allows  the  decisio-  maker  to  see  at  a 
glance  all  the  information  which  may  become  lost  in  a  tabular  maze. 

B.  THE  PROCESS  -  CRAPH1C  ANALYSIS 


The  graphic  techniques  which  follow  may  be  applied  as  necessary  to 
constant,  current  or  discounted  dollars.  In  fact,  each  of  the  alternatives 
not  only  can,  but  should  be  examined  using  at  least  constant  and  discounted 
dollars  when  dollar  costs  are  available.  Tables  or  graphs  may  be  plotted 
from  raw  data,  assuming  that  the  costs  and  benefits  have  both  been  fully 
quantified  in  terms  of  some  measure  of  merit  such  as  dollars.  That  is  not 
to  say  that  some  other  measure  of  effectiveness  or  benefit  might  not  be 
more  appropriate.  One  could  measure  benefits  in  theoretical  units  of 
utility  or  in  some  more  real-world  related  unit  such  as  calories  for  a 
heating  system  or  passengers  carried  for  a  bus  pool. 

1.  Graphic  Analysis  of  the  data  can  be  accomplished  by  plotting  the 
total  costs  over  the  period  of  comparison  for  each  alternative  as  a  function 
of  the  benefits  as  in  Figure  1. 
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THE  PROCESS  OF  COMPARING  ALTERNATIVES 
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CONSTANT  DOLLARS 


DISCOUNTED  DOLLARS 


COSTS 

DOLLARS 


1C 

CURRENT  YEAR  DOLLARS 


ID 

CURRENT  YEAR  DOLLARS 


Figure!:  COST  VS  BENEFITS 


3. 


'V*V' 


2A 

HIGH  BUDGET  CONSTRAINT 


Fiaure  2:  COST  BENEFITS  WITH  DOMINANCE  AND 
TWO  DIFFERENT  BUDGET  CONSTRAINTS 


Figures  3 &4:  COST/BENEFITS  WITH  NO  DOMINANCE 
AND  WITH  UNCERTAINTY 
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In  figure  1,  one  alternative  (A3)  dominates  all  the  others  (has  lower 
total  costs  for  any  level  of  benefit),  regardless  of  the  dollar  base  chosen. 
In  such  a  case,  the  decision  is  clear-cut  and  constrained  only  by  the  budget 
limitation. 

In  figure  2,  we  see  the  effect  of  a  budget  limitation.  If  the  budget 
Is  expected  to  be  at  the  level  BH  shown  in  figure  2a,  then  it  is  immediately 
clear  to  the  decision  maker  that  he  can  achieve  levels  EH1,  EH2,  and  EH3, 
of  effectiveness  with  alternatives  A1 ,  A2,  and  A3,  respectively.  The  alter¬ 
native  which  has  the  greatest  benefit  for  the  expected  budget  constraints 
ranks  highest . 

Unfortunately,  it  is  not  often  that  there  exists  such  strict  dominance 
of  one  alternative  over  the  other.  Figure  3  is  probably  somewhat  more 
typical  of  the  problems  encountered  in  the  real  world.  In  fact,  if 
uncertainty  about  costs  and  benefits  is  taken  into  consideration,  the 
problem  more  closely  resembles  figure  4,  where  each  alternative  nw  presents 
a  non-discrete  band  on  the  graph  of  cost  vs  benefit. 

2.  Graphic  Analysis  of  benefits  Over  Time  (Fixed  Cost)  -  (Branch  "a" 
in  the  graphic  presentation  of  the  Process. 

If  complete  dominance  of  one  alternative  over  the  others  does  not 
occur  in  a  total  cost  vs  benefit  plot,  or  if  it  ocrurs  only  in  constant 
dollars  but  not  in  discounted  dollars,  for  example,  then  further  analysis 
is  needed  before  the  proposals  can  be  ranked  conclusively.  The  most  common 
constraint  on  the  problem  is  a  fixed  budget  level.  In  such  a  case,  one 
can  limit  the  level  of  expenditure  for  any  alternative  and  then  compute 
the  benefits  or  effectiveness  of  each  alternative  in  some  common  measure 
of  merit  at  that  fixed  level.  For  instance,  one  might  plot  the  benefits 
for  each  alternative  as  a  function  of  time  for  the  given  budget  constraint 
(see  figure  5).  The  budget  limitation  could  be  either  an  annual  or  a 
total  expenditure  limit. 

Again,  if  there  is  clear  dominance  of  one  alternative  over  the  others 
(figure  5a)  for  all  periods  of  time  considered,  then  this  proposal  would 
rank  highest.  As  mentioned  before,  this  is  not  the  most  common  situation 
in  the  real  world,  since  alternatives  tend  to  overlap  or  to  have  uncertain 
benefits  over  time  as  figures  5b  and  5c  indicate. 

If  the  economic  life  of  a  given  alternative  is  knewn  with  some  proba¬ 
bility  to  be  10  or  11  years,  then  we  can  select  the  alternative  which 
maximizes  benefits  over  an  economic  lifetime  as  Indicated  by  figure  5b. 

We  may  also  plot  each  alternative  with  respect  to  the  working  time 
or  use-time  we  expect  from  our  alternative  systems.  That  is,  the  bene¬ 
fits  of  two  machines  might  vary  widely,  depending  upon  the  intensity  with 
which  they  are  employed.  For  example  figure  5c  would  indicate  that  alter- 
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5A  5B 

DOMINANCE  OVER  TIME  NO  DOMINANCE  OVER  TIME 


INDIFFERENCE  POINT 
FOR  PERIOD  OF 
COMPARISON 


5C 

UNCERTAINTY  AND  NO  DOMINANCE  OVER  TIME 


U,  INDIFFERENCE  POINT  FOR  USAGE  TIME 


Figure  5:  BENEFITS  VS  TIME  AT  FIXED  BUDGET  LEVEL 
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Figure  6:  ALTERNATIVES  WITH  UNEQUAL  COSTS 
AS  A  FUNCTION  OF  TIME  AT  FIXED  OR 
SPECIFIED  EFFECTIVENESS  LEVELS 
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Figure  7:  CUMULATIVE  COSTS  VS  TIME  AS  A 
FUNCTION  OF  TIME  AT  FIXED  OR 
SPECIFIED  EFFECTIVENESS  LEVELS 
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native  Al  is  the  proper  choice  for  all  usage  times  less  than  Ul,  while  A2 
would  be  the  choice  for  the  higher  range  of  system  use  time. 

3.  Graphic  Analysis  of  Cost  Over  Time  (Fi-xed  or  Specified  Benefit)  - 
(Branch  "b"  in  the  graphic  presentation  of  The  Process.) 

If  the  budget  constraint  is  variable  and  subject  to  control  by  the 
immediate  level  of  decision  maker,  as  is  often  the  case  for  base  level 
projects,  then  a  fixed  benefit/variable  cost  analysis  may  be  appropriate. 

Tlie  procedure  is  conceptually  similar  to  that  just  covered. 

Again,  as  in  the  case  of  fixed  cost/variab le  effectiveness,  there  is 
rarely  a  dominant  alternative  for  all  periods  of  time.  One  must  usually 
do  some  further  analysis  to  be  able  to  rank  the  proposals. 

One  very  simple  procedure  is  to  plot  the  cumulative  costs  over  time 
at  the  same  fixed  effectiveness  schedule  used  before  in  plotting  the 
annual  costs.  Using  this  straight-forward  technique,  it  is  quickly 
apparent  to  the  decision  maker  at  which  point  in  time  one  alternative  begins 
to  represent  savings  (the  difference  between  cumulative  costs  of  each 
alternative)  with  respect  to  the  other  (see  figure  7),  and  the  total 
expenditure  at  that  point.  In  fact,  one  alternative  may  not  have  to  dominate 
the  other  for  all  periods  of  time  if  the  useful  life  (or  economic  lifetime) 
of  both  alternatives  ends  (at  I,  in  figure  7)  before  the  second  one  begins 
to  shew  savings . 

From  the  cumulative  o  3t  calculations,  one  can  also  derive  a  very 
useful  presentation  by  simply  subtracting  the  costs  of  one  alternative 
from  the  ether,  thus  plotting  savings  (this  method  is  not  limited  to  two 
alternatives,  but  graphical  presentation  of  more  than  two  may  be  dilficult 
unless  each  is  compared  to  some  status  quo  alternative).  Thus,  the  plot 
of  savings  over  time  will  show  the  decision  maker  at  a  glance  the  savings 
for  any  given  year. 

In  figure  8  we  will  suppose  AO  is  our  status  quo  alternative.  We  can 
see  (figure  8a)  that  up  to  time  To  our  status  quo  situation  (AO)  costs  less 
than  either  alternative  Al  or  A2.  However,  beyond  To,  alternative  Al  appears 
to  be  less  costly.  Moreover,  later  in  time,  ( t2) ,  A2  becomes  less  costly 
than  either  of  the  other  alternatives  and  least  costly  overall. 

In  figure  8b,  we  plot  the  relative  savings  of  alternatives  Al  and  A2, 
using  AO  as  our  base.  With  a  graph  such  as  this,  the  d  clsion-maker  can 
determine  quite  easily,  the  net  savings  due  to  each  alternative.  If  the 
cumulative  savings  over  the  period  of  comparison  Is  positive  for  either 
alternative  Al  or  A2,  then  they  are  relatively  better  investments  than 
the  status  quo  alternative,  AO.  If  the  period  of  comparison  is  longer 
than  t2,  then  A2  will  clearly  have  the  greatest  savings  of  the  3  alter¬ 
natives  . 
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Figure  9:  SUMMARY  PRESENTATION 


4.  A  Comprehensive  Format 

Now  that  the  bulk  of  the  analysis  has  been  pe. formed  and  the  results 
displayed  in  basic  graphical  format,  it  might  be  interesting  to  consider 
other  informative,  useful  means  of  presenting  these  graphs  to  the  decision 
maker.  When  there  are  several  types  of  dollar  bases  to  consider  or  if  one 
wants  to  see  the  benefits  or  costs  at  several  constraint  levels,  the 
following  format  is  useful. 

Basically  this  presentation  is  a  sequence  of  four  graphs  oriented  as 
shown  in  figure  9.  In  the  upper  left  one  would  display  the  basic  data  of 
the  problem,  e.g.,  costs  versus  benefits  (figure  9a).  One  might  fix  the 
benefits  at  some  appropriate  schedule  and  display  the  cumulative  or  annual 
costs  to  achieve  the  given  benefit  level  as  a  function  of  time  on  a  graph 
immediately  below  the  first  one  (figure  9c).  Alternatively,  one  could 
adopt  the  fixed  cost  level  approach  and  plot  benefits  versus  time  for  a 
given  budget  (figure  9b). 

Finally,  one  may  plot  savings  over  time  with  fixed  effectiveness  in 
the  fourth  quadrant  graph  to  complete  the  summary  of  key  information.  The 
point  of  comparison  where  one  is  indifferent  between  alternatives  (tl) 
should  be  clearly  indicated.  The  four  plots  can  usually  be  compressed  to 
a  single  page  so  that  the  reader  may  track  quickly  from  one  to  the  other 
and  draw  the  appropriate  conclusions. 

This  four  graph  technique  can  be  used  for  each  of  the  steps  of  the 
analysis  and  for  as  many  levels  of  detail  as  desired.  We  may  use  discounted 
dollars  or  other  dollar  bases.  Figure  9d  shows  a  concise  presentation 
of  the  savings  analysis.  Clearly,  this  four  graph  method  can  be  used  to 
display  data  in  several  useful  ways.  One  should  exercise  some  judgment 
In  not  attempting  too  much  detail  or  use  multigraph  approach  when  a  single 
one  would  make  the  case  adequately. 

C.  CONCLUSION:  WHAT  TO  DO  WITH  THE  RESULT  OF  THE  ANALYSIS 

1.  When  Results  are  Inconclusive 

It  is  not  unusual  to  perform  all  of  the  above  analyses  and  discover 
that  it  is  still  not  possible  to  arrive  at  a  concrete  ranking  of  the 
alternatives  because  the  constraints  on  the  problem  fall  within  wide  ranges. 
If  this  difficulty  arises  there  may  be  several  reasons,  normally  involving 
an  amount  of  uncertainty  in  cost  and  benefit  quantification,  knowledge  of 
the  budget  limitations,  or  uncertain  specification  of  the  benefits  to  be 
achieved.  Depending  on  the  particular  difficulty  involved,  there  are 
several  complex  tools  for  analysis  which  may  be  more  useful  than  the  ones 
discussed  here.  Linear  programming,  Lagrange  multipliers,  dynamic 
programming,  Markov  processes,  game  theory,  the  Delphi  Technique,  network 


44 


analysis,  and  integer  programming  are  some  of  the  more  commonly  used  of 
these  more  sophisticated  techniques.  A  detailed  discussion  of  each  of 
these  methods  is  beyond  the  scope  of  this  book.  In  addition,  the  vast 
majority  of  economic  analyses  which  will  be  performed  can  be  adequately 
conducted  by  the  techniques  outlined  in  detail  above. 

2.  When  Results  are  Conclusive 

When  the  analysis  has  been  sufficient  to  provide  a  meats  of  ranking 
the  alternatives  conclusively  one  is  faced  with  a  new  problem.  Should  the 
decision  maker  be  presented  with  a  hard  and  fast  conclusion  made  explicit 
in  the  text  of  the  study,  or  should  one  simply  make  a  few  final  observations 
and  let  the  analysis  speak  for  itself?  The  answer  to  this  question  depends 
on  the  attitude  of  the  decision  maker  and  on  the  nature  of  the  analytical 
results.  Many  decision  makers  dislike  being  given  a  single  answer.  They 
prefer  to  examine  the  graphical  presentation  and  draw  their  own  conclusions. 
This  is  more  a  question  of  personalities  than  analytical  expertise,  but 
should  be  taken  into  consideration  if  the  study  is  to  be  well  received. 

On  the  other  hand,  most  analyses  won't  be  conclusive  and  will  allow 
various  rankings  of  the  proposals  subject  to  certain  sets  of  constraints. 

In  this  case  it  is  helpful  to  present  a  ranking  of  alternatives  for  each 
set  of  constraints  and  to  provide  information  needed  for  the  decision  maker 
to  form  his  own  opinions  about  the  likelihood  of  each  of  the  constrained 
problems . 

In  order  to  aid  the  decision  maker  in  determining  which  of  these  subsets 
is  more  likely  and  which  alternative  should  be  selected  from  the  rankings, 
the  Intangible  considerations  must  be  presented.  Format  "B"  of  DoD 
Instruction  7041.3  may  be  used  to  present  intangible  outputs.  Little  can 
be  said  about  the  details  of  this  presentation  due  to  the  number  of 
different  situations  that  may  be  encountered.  However,  one  should  attempt 
to  be  impartial  and  complete  in  describing  each  relevant  factor  and 
arranging  them  in  some  appropriate  format. 

Finally,  if  the  salvage  or  other  residual  value  of  a  proposed  investment 
is  quite  uncertain  and  has  not  been  included  in  the  cumulative  cost 
calculations,  then  it  might  be  better  to  rank  the  alternatives,  initially, 
without  considering  the  residuals.  Then,  as  an  aid  to  the  decision  maker 
in  considering  sensitivity,  residual  value  can  be  shown  as  an  intangible 
and  the  ranking  procedure  repeated. 

3.  The  Big  Picture  -  Externalities 

No  study  of  alternative  proposals  for  an  investment  should  be  conducted 
in  the  dark.  This  is  to  say,  an  analyst  should  try  to  be  aware  of  other 
investment  proposals  which  will  be  competing  for  the  same  budget  dollars. 

For  instance,  it  would  be  short  sighted  indeed  to  perform  the  above  analyses 
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at  fixed  cost  levels  which  requited  the  entire  budget  to  be  dedicated  to 
each  alternative.  A  good  analyst  would  also  realize  that  'he  decision 
maker  will  not  be  able  to  consider  an  alternative  which  exceeds  his  budget, 
regardless  of  the  levels  of  effectiveness  achieved. 


On  the  other  hand,  once  a  budget  limitation  is  established,  it  is  still 
useful  to  rank  the  alternatives  according  to  effectiveness  at  several 
levels  of  fixed  cost  within  the  given  budget  constraint.  The  premise  here 
is  that  even  a  low  investment  alternative  may  be  better  than  the  status  quo. 
But  if  the  decision  maker  is  shown  only  an  array  of  high  investment  propo¬ 
sals,  he  may  not  accept  any  of  them,  leaving  the  problem  with  what  could  be 
a  highly  undesirable  status  quo  solution.  In  short,  the  analyst  should 
attempt  to  incorporate  the  big  picture  into  his  i’  Itial  approaches  to  the 
problem,  not  realize  too  late  that  the  conclusions  will  be  unacceptable 
to  the  decision  maker,  regardless  of  the  accuracy  of  the  computational  work. 
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A  GUIDE  FOR  REVIEWERS 


CHAPTER  VI  - 

A.  THE  OBJECTIVE,  ASSUMPTIONS  AND  ALTERNATIVES 

1.  Is  the  problem  stated  the  real  problem? 

2.  Are  all  reasonable  assumptions  identified  and  explained? 

3.  Are  assumptions  too  restrictive?  Too  broad? 

4.  Are  intuitive  judgments  identified  as  such?  Are  uncertainties 
treated  as  facts?  Can  the  facts  be  verified? 

5.  Are  any  feasible  alternatives  omitted? 

6.  Are  the  alternatives  well  defined  and  discrete?  Do  they  overlap? 

B.  THE  COST  ESTIMATE 


1.  What  costing  method  was  used?  Is  it  appropriate? 

2.  Are  all  relevant  costs  included?  Are  directly  related  support 
and  training  costs  included? 

3.  Does  the  study  Indicate  why  certain  costs  were  considered  relevant 
and  others  not? 

4.  Are  sunk  costs  excluded? 

5.  Are  the  sources  of  cost  data  included?  Are  they  accurate? 

6.  Are  the  Cost  Estimating  Relationships  valid,  if  the  parametric 
method  was  used?  Are  extrapolations  used  without  proof? 

C.  THE  BENEFIT  DETERMINATION 

1.  Does  the  analysis  ignore  some  portion  of  total  output? 

2.  Were  the  criteria  used  to  measure  benefit  justified  by  the  context 
of  the  study? 

3.  Was  the  benefit,  in  fact,  unmeasurable?  Has  there  been 
a  rational  assessment  of  non-quant if iab le  factors? 

4.  Was  expert  opinion  used?  Were  these  experts  properly  qualified? 
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D.  SELECTING  FROM  ALTERNATIVES 


1.  Are  the  recommendations  logically  derived  from  the  material? 

2.  Is  interference  from  co-extenslve  or  parallel  operations  Ignored? 

3.  Are  the  recommendations  feasible  in  the  real  world  of  political, 
cultural,  or  policy  considerations? 

4.  Are  the  recommendations  based  upon  significant  differences  between 
the  alternatives? 

5.  Are  recommendations  intuitively  satisfying  and  supportable?  Should 
"a  fortiori"  analysis  be  conducted  in  favor  of  a  certain  alternative? 

6.  Is  an  uncertainty  analysis  needed?  Were  the  methods  and  sources 
of  the  study  adequately  documented? 

7.  Do  benefits  exceed  costs  for  alternative;  considered? 

8.  Were  present  value  estimates  used? 

9.  Are  cost  factors  current  and  supportable? 
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